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(54) Terminal apparatus and method for achieving interactive operations 



(57) A terminal apparatus is provided for displaying 
an image by reproducing a piece of image information 
and for interactively changing the image using naviga- 
tion information. The image is a moving picture, a still 
picture, or a mixture of them. The image information and 
the navigation information together are broadcast by a 
broadcasting station to the terminal apparatus. The nav- 
igation information indicates a plurality pieces of link- 
target image information The cache unit stores a pair 
of image information and navigation information. The re- 
producing unit reproduces the image information. The 
monitoring unit monitors whether an operator has per- 
formed a certain operation responding to the image dis- 
played. The receiving unit, before the operator performs 
the certain operation, receives a plurality pieces of im- 



age information which have possibility of being dis- 
played and a plurality pieces of corresponding naviga- 
tion information based on the navigation information, 
and stores the plurality pieces of image information and 
navigation information in the cache unit. The specifying 
unit specifies a piece of link-target image information 
based on the certain operation. The identifying unit iden- 
tifies the piece of link-target image information as a 
piece of image information. The first controlling unit 
reads the piece of link-target image information and in- 
structs the reproducing unit to reproduce the piece of 
link-target image information, and instructs the receiving 
unit to receive other plurality pieces of image information 
and navigation information based on a piece of naviga- 
tion information corresponding to the link-target image 
information identified by the identifying unit. 
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Description 

BACKGROUND OF THE INVENTION 

(1) Field of the invention 

This invention relates to a terminal apparatus used 
in communication sen/ices such as digital satellite 
broadcasting and digital CATV (Community Antenna 
Television), and to a method used for the terminal ap- 
paratus. 

(2) Description of the Prior Art 

As the number of channels provided in the satellite 
broadcasting or CATV has increased greatly, competi- 
tion among broadcasting companies has been intensi- 
fied. Broadcasting companies hope that broadcasting 
systems known as. interactive TV broadcasting systems 
wilt attract many viewers, and active studies into inter- 
active TV broadcasting systems are under way The 
term "interactive" indicates that the user can display de- 
sired images by making requests. Suppose for exam- 
ple, each screen includes a plurality of icons which are 
related to other pieces of image information which form 
screens It is supposed that in the interactive TV broad- 
casting system, a desired piece of image information is 
displayed when the operator selects an icon on the in- 
teractive screen. The operator feels as if he/she could 
display what he/she desired. Such an interactive TV 
broadcasting system is epoch-making in TV broadcast- 
ing where one-way broadcasting has long been the 
norm. There is a possibility that the interactive TV broad- 
casting system will become a next -generation standard 
for TV broadcasting system. 

Such an interactive TV broadcasting system may 
be achieved by a method in which each terminal appa- 
ratus sends a request for transmitting a desired piece of 
image information to the broadcasting station, and in re- 
sponse, the broadcasting station transmits the desired 
piece of image information to the terminal apparatuse. 
For achieving this, the broadcasting station needs to 
store a large amount of image information which can be 
provided to the terminal apparatuses 

It is increasingly difficult to achieve the above sys- 
tem as the number of terminal apparatuses increases 
This is because a number of communication tines need 
to be provided for transferring the transmission requests 
and image information Such a construction may also 
suffer from an overflow in handling the transmission re- 
quests in the broadcasting station due to an overflow in 
the communication lines which are used for transferring 
the read requests and image information. Viewers may 
stop using such an interactive TV broadcasting system 
if it takes very long to display a desired image 



SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to 
provide a terminal apparatus and a method used therein 

s for immediately displaying a desired piece of image in- 
formation in an interactive broadcasting system upon re- 
quest of the operator, where a large number of terminal 
apparatuses receive broadcasts in the interactive 
broadcasting system. 

io The above object is achieved by a terminal appara- 
tus for displaying an image by reproducing one out of m 
pieces of image information and for interactively chang- 
ing the image using n pieces of navigation information, 
where the image is one of a moving picture, a still pic- 

is ture. and a mixture of a moving picture and a still picture, 
where the m pieces of image information and the n piec- 
es of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, where 
each piece of navigation information is related to an or- 

20 igin piece of image information and indicates a plurality 
pieces of link-target image information, where m and n 
are each an integer either of being equal to and larger 
than "1 " the terminal apparatus including: a cache unit 
for storing a pair of one out of the m pieces of image 

25 information and one out of the n pieces of navigation 
information reproducing unit for reproducing the one 
out of the m pieces of image information stored in the 
cache unit" monitoring unit for monitoring whether an op- 
erator has performed a certain operation responding to 

30 the image displayed: a receiving unit for. before the 
monitoring unit determines that the operator has per- 
formed the certain operation, receiving s pieces of im- 
age information which have possibility of being dis- 
played and t pieces of navigation information respec- 
ts tively related to the s pieces of image information based 
on the one out of the n pieces of navigation miormation 
stored tn the cache unit and storing the s pieces of im- 
age information and the t pieces of navigation informa- 
tion in the cache unit, where s is an integer satisfying 

40 i^s<m, and t is an integer satisfying l^t<n: a specify- 
ing unit for specifying one out of the plurality pieces of 
link-target image information based on the certain oper- 
ation when the monitoring unit monitors that the opera- 
tor has performed the certain operation: an identifying 

+5 unit for identifying the one out of the plurality pieces of 
Sink-target image information specified by the specifying 
unit as one out the s pieces of image information stored 
tn the cache unit, and a first controlling unit for reading 
the piece of link-target image information identified by 

50 the identifying unit and instructing the reproducing unit 
to reproduce the piece of link-target image information 
and instructing the receiving unit to receive other s piec- 
es of image information and other t pieces of navigation 
information based on one out of the t pieces of naviga- 

ss tion information in the cache unit corresponding to the 
piece of link-target image information identified by the 
identifying unit. 

With such a construction, a desired piece of image 
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information is immediately displayed The current 
screen is changed to the next screen at high speed upon 
request of the operator since while the current screen is 
displayed, a plurality pieces of fink-target image infor- 
mation and corresponding pieces of navigation informa- 
tion are stored in the cache unit. The above screen 
change is also performed using the waiting time of the 
terminal apparatus for a period during which the opera- 
tor determines an icon on the screen. 

The above terminal apparatus may further include: 
a superimposing unit for superimposing based on a 
piece of navigation information corresponding to the one 
out of the m pieces of image information stored in the 
cache unit, a plurality of icons on the image which is 
displayed when the reproducing unit reproduces the one 
out of the m pieces of image information, where the 
monitoring unit includes: a determination operation de- 
tecting unit for detecting a determination operation per- 
formed on one out of the plurality of icons, where the 
identifying unit identifies one out of the plurality pieces 
of link-target image information detected by the deter- 
mination operation detecting unit. 

With such a construction, a visual interactive oper- 
ation is achieved since a plurality of icons which indi- 
cate link-target pieces of image information, are super- 
imposed on the screen image. 

In the above terminal apparatus, the reproducing 
unit may include: a focus setting unit for making one out 
of the plurality of icons be in focus, where the monitoring 
unit includes: a cursor move operation detecting unit for 
detecting a cursor move operation: and a focus chang- 
ing unit for making another one out of the plurality of 
icons be in focus based on the cursor move operation 
detected by the cursor move operation detecting unit, 
where the determination operation detecting unit de- 
tects a determination operation performed on the other 
one out of the plurality of icons in focus 

With such a construction, the cursor (icon in focus) 
is moved based on the interactive operation. This ena- 
bles cursor moves with the use of cross keys. 

The above terminal apparatus may further include: 
a rank setting unit for setting ranks of the m pieces of 
image information stored in the cache unit based on 
possibility of being displayed: and a cache table regis- 
tering unit for registering identifiers of high ranking s 
pieces of image information in a cache table, out of the 
m pieces of image information and registering identifiers 
of t pieces of navigation information corresponding to 
the high ranking s pieces of image information, where 
the receiving unit receives the s pieces of image infor- 
mation whose identifiers are registered by the cache ta- 
ble registering unit and receives t pieces of navigation 
information corresponding to the s pieces of image in- 
formation 

With such a construction, a certain number of piec- 
es of image information having possibility of being dis- 
played are stored in the cache unit. Therefore, these 
pieces of image information and corresponding naviga- 



tion information are displayed with high probability. 

The above terminal apparatus may further include 
a weighting unit for weighting with a highest value, the 
one out of the plurality of icons made to be in focus by 
s the focus setting unit, and for weighting, with a second 
highest value, icons adjacent to the one in focus, where 
the rank setting unit sets ranks of the m pieces of image 
information based on values weighted by the weighting 
unit. 

io With such a construction, information related to the 
icon in focus and the adjacent icons is stored in the 
cache unit. Therefore, these pieces of image informa- 
tion and corresponding navigation information are dis- 
played with high probability 

is The above terminal apparatus may further include, 
a statistics value storing unit for storing a statistics value 
for each piece of image information which indicates a 
number of times the piece of image information has 
been determined, where the rank setting unit sets ranks 

20 of the m pieces of image information based on the sta- 
tistics value for each piece of image information. 

With such a construction, the possibility of being 
displayed is evaluated based on the statistics values. 
Therefore, these pieces of image information and cor- 

25 responding navigation information are displayed with 
high probability. '* - 

The above terminal apparatus may further include 
a rank information detecting unit for detecting a piece of 
rank information from the piece of navigation informa- 

30 tion corresponding to the one out of the m pieces of im- 
age information reproduced by the reproducing unit, 
where the piece of rank information includes ranks of 
the plurality pieces of link-target image information, 
where the rank setting unit sets ranks of the m pieces 

35 of image information based on the piece of rank infor- 
mation 

With such a construction, the possibility of being 
displayed is evaluated based on the rank included in 
each piece of navigation information. Therefore these 
io pieces of image information and corresponding naviga- 
tion information are displayed with high probability. 

BRIEF DESCRIPTION OF THE DRAWINGS 

15 These and other objects, advantages and features 
of the invention will become apparent from the following 
description thereof taken in conjunction with the accom- 
panying drawings which illustrate a specific embodi- 
ment of the invention In the drawings: 

so 

FIG.1A shows a pictorial view of a satellite broad- 
casting system: 

F1G.1B shows the construction of the transport 
stream which is divided into a number of transport 
55 packets. 

FiG 2A shows the first frame of video elemental] 
and a corresponding voice in audio elemental ]. both 
included in presentation stream[1): 
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FIG.2B shows the first frame of video element[2] 

and a corresponding voice in audio element[2]. both 

included in presentation stream[2]: 

FIG.2C shows the first frame of video element[l2] 

and a corresponding voice in audio element[l2]. 5 

both included in presentation stream[l2]: 

FIG. 2D shows the first frame of video e!ement[43] 

and a corresponding voice in audio e1ement[43], 

both included in presentation stream[43): 

FIG. 3 shows the content of NVT[1 ]: io 

FIG. 4 shows the content of NVT[2]: 

FIG .5 shows the content of NVT[12]: 

FIG. 6 shows the content of PMT: 

FIG. 7 shows a tree structure formed with NVTs and 

"contents:" 15 

FIG 8 A shows an appearance of the viewing system 

for satellite broadcasting: 

FIG.8B shows the front panel of handy remote con- 
troller 4: 

FIG. 9 shows the construction of terminal apparatus 20 

2: 

FIGS.10A-10G show contents of navigation cache 
unit 14: 

Fl Gs. 1 1 A-1 1 G show contents of presentation cache 
unit 15: 25 
FIG. 12 shows a statistics table stored in statistics 
table storing unit 18: 

FIG.13A shows a cache table which is generated 
based on the statistics table; 

FIG.13B shows a cache table which is generated 30 

based on the "rank" column in the hyperlink table: 

FIG.13C shows a cache table which is generated 

based on the icon currently in focus: 

FIG. 14 shows the main flowchart of the operation 

of cache manager 17. 35 

FIG. 15 shows the flowchart of cache manager 17 

in reading contents in advance' 

FIG. 16 shows the flowchart of cache manager 17 

in generating the cache table: 

FIG. 17 shows the flowchart of cache manager 17 -to 
in reading contents in advance: 
FIG 18 shows the main flowchart of the operation 
of browser 25: 

FIG. 19 the flowchart of browser 25 in switching in- 
teractive screens 45 
FIG. 20 the flowchart of browser 25 in switching in- 
teractive screens. 

FIG 21 the flowchart of browser 25 in switching in- 
teractive screens: 

FIG 22A shows an interactive screen which is an so 
image generated from presentation stream[1) with 
the icons of NVT[1] superimposed on the image: 
FIG.22B shows an interactive screen which is an 
image generated from presentation stream[2] with 
the icons of NVT[2] superimposed on the image. 55 
FIG.22C shows an interactive screen which is an 
image generated from presentation stream[l 2] with 
the icons of NVT[1 2] superimposed on the image: 



FIG.22D shows an interactive screen which is an 
image generated from presentation stream[43] with 
the icons of NVT[43] superimposed on the image: 
FIG . 23 shows the contents of the transport streams 
including still pictures 
FIG.24A shows the content of VET[15]: 
FIG.24B shows the content of VET[16]: and 
FIG. 25 shows a content of the hyperlink table. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

<First Embodiment 

To achieve an interactive TV broadcasting system 
connected to a large number of terminal apparatuses 
set in a number of households, tt is not ideal to allow the 
terminal apparatuses to send requests for transmitting 
images The present embodiment achieves an interac- 
tive TV broadcasting system in which requests for trans- 
mitting images are not sent from the terminal appara- 
tuses. In the present embodiment, a TV broadcasting 
station sends a plurality of images to a plurality of ter- 
minal apparatuses so that the terminal apparatuses 
each can interactively select and receive a desired im- 
age. 

In such a broadcasting system, the interactivity is 
achieved by one-way image transmission since it is not 
necessary for the terminal apparatuses to send image 
transmission requests to the TV broadcasting station. 
On the other hand, the TV broadcasting station is re- 
quired to send quite a large number of images to the 
terminal apparatuses since it must send all the neces- 
sary images for achieving the interactivity When this 
happens, that is. when the number of sent images in- 
creases, the time taken to receive and display the im- 
ages also increases 

FIG.1A shows a pictorial view of a satellite broad- 
casting system described in the present embodiment 
As shown in this drawing broadcasting station 100 
transmits a broadcasting wave to broadcasting satellite 
200. as indicated by dotted line hi . Broadcasting satel- 
lite 200 sends this broadcasting wave to a wide region 
on the earth, as indicated by dotted lines h2 h3. h4. and 
h5. so that terminal apparatuses in this region receive 
the broadcasting wave Broadcasting station 100 and 
broadcasting satellite 200 repeat such transmissions in 
a unit cycle of several minutes This enables a large 
number of terminal apparatuses in the region to receive 
the broadcasting wave. 

The broadcasting wave mentioned above is a car- 
rier wave which has been modulated from transport 
streams with the QPSK (Quadrature Phase Shift Key- 
ing) method. 

Each of the transport streams is composed of vari- 
ous types of data, or multiple data. The transport stream 
is defined in detail in MPEG (Motion Picture Experts 
Group). A transport stream is composed of a large 
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number of transport packets. The transport packet is 
used for transmitting data and is the smallest unit of data 
whose transmission is assured. Each transport packet 
includes an error detection code and an error correction 
code. 

FIG.1B shows the construction of the transport 
stream. The transport stream is represented by a hori- 
zontally-long rectangle in the upper part of the drawing, 
the transport stream being divided into a number of box- 
es representing transport packets. 

The lower part of FIG. 18 shows a plurality of sub- 
streams of the transport stream. The sub-streams are: 
a video elementary stream which is composed of video 
elements (represented each as "VE" in the drawing), an 
video elementary stream which is composed of audio 
elements (represented each as "AE" in the drawing), a 
navigation information table (NVT) sub-stream which is 
composed of NVTs (represented each as "NVT" in the 
drawing), a program clock reference (PGR) table sub- 
stream (represented each as "PCR" in the drawing) for 
synchronizing the video elements with the audio ele- 
ments, a program association table (PAT) sub-stream 
which is composed of PATs (represented each as "PAT" 
in the drawing) a program map table (PMT) sub-stream 
which is composed of PMTs (represented each as 
"PMT" in the drawing), a network information table (NIT) 
sub-stream which is composed of NITs (represented 
each as "NIT" in the drawing) for indicating which satel- 
lite is used to relay the transport packets, that is. for in- 
dicating to which network the transport packets belong, 
a service description table sub-stream (represented as 
"SDT" in the drawing) for indicating which program is 
broadcast by the transport packets, that is. for indicating 
to which service the transport packets belong, and an 
event information table (EIT) sub-stream which ts com- 
posed of ElTs (represented each as "EIT" in the draw- 
ing) for indicating to which channel, namely to which 
event, the transport packets belong. For more informa- 
tion on the above sub-streams, refer to ETS 300 468 
standard (DVB-SI standard) and ISO/IEC 13613-1 
(MPEG2 system standard). 

As described above, transport streams, each in- 
cluding various types of data as shown in F1G.1B. are 
transmitted. 

Each transport packet, which belongs to a video el- 
ement or an audio element, includes a packet identifier 
(PID) which indicates to which element the transport 
packet belongs 

A plurality of video elements, audio elements, and 
PCRs make up a presentation stream which corre- 
sponds to one scene in a film. 

VE[1]. VE [2\.. VE[12]. VE[43] . . in FIG. 1 B include 
their own PIDs. For example. VE[1] includes PtD 
"0x202 " VE[2] includes PtD '0x302." 

FIGs.2A-2D show examples of audio elements and 
video elements making up a presentation stream. 

Presentation strer.mp] includes audio element[1] 
with PID "0x601" and video etementp ] with PID "0x202." 



FIG.2A shows a scene which is obtained by decoding 
video element[1). In this scene, an announcer of a 
broadcasting company makes an introductory speech 
for about two-minutes. The video elementp] is accom- 
5 panied by audio etementp j which includes a narration: 
"INTRODUCING INTERACTIVE CHANNEL. THANK 
YOU FOR SELECTING THE 'A' BROADCAST. FOR 
TODAY'S BROADCAST. WE WILL BE SHOWING THE 
FOLLOWING PROGRAMS. WE ARE SURE YOU WILL 
'£? ENJOY THEM." 

Presentation stream[2] includes audio element[2] 
with PID "0x602" and video element[2] with PID "0x302 " 
FIG.2B shows a scene which is displayed by decoding 
video element[2] The scene provides a preview of films 
is to be released soon. The video element[2] is accompa- 
nied by audio element[2] which includes a narration: 
"NEW MOVIE INFORMATION. COMING UP SOON AT 
THEATERS IN OSAKA." 

FIGs.2C and 2D respectively show the content of 
20 presentation streams[12] and [43]. Presentation 
streamsp 2] and [43] respectively include the shots and 
narrations shown in the drawings. 

The "NVT" is important as a private section under 
ISO/IEC 13813-1 standard. Each private section can 
25 additionally include a "table_id_extension" which is 
called a table identifier Each of NVTs[0]. [1]. [2]. and 
[1 2] shown in FIG 1 B. for example, includes a common 
PID. "0x0082." NVT [0] also includes table identifier 
"0x0000 " NVT[1] includes table identifier "0x0001." 
30 NVT[2] table identifier "0x0002." and NVT[i2] table 
identifier "0x0012." That means, a video element or an 
audio element identifies itself with a PID: an NVT iden- 
tifies itself with a table identifier. 

Now. the navigation information table (NVT) is de- 
35 scribed. 

The NVT includes navigation information which is 
used for displaying icons on the screen and moving the 
icons based on interactive operations made with the op- 
erator. The icons in the present embodiment are any of 
40 patterns, characters, and colors, or combinations of 
these elements. The icons are used to inform the oper- 
ator of the content of information, and is used as option 
items A representative method of indicating a selected 
icon is a cursor display The cursor display described 
45 here is a different color of one icon than the other icons 
displayed on the screen This is an effective way for 
drawing the attention of the operator to the icon. The 
icon with the different color is also called an icon in fo- 
cus. That means as the cursor moves, the color of the 
50 jcon also changes 

Now. the data structure of the NVT is described with 
reference to FIGs.3 4. and 5. 

FIG. 3 shows the content of NVT[1] shown in FIG. 
1B FIG. 4 shows the content of NVT[2] shown in FIG 
55 IB. FIG. 5 shows the content of NVT[12] shown in FIG 
1B. Each NVT is composed of bitmap table 301. objec: 
definition table 302. handler definition table 303 and hy- 
perlink table 304. Each piece of information in each table 
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is related to each other For example, a piece of infor- 
mation with index number 1 in the object definition table 
302 is related to a piece of information with HD__index 
number 1 in the handler definition table 303 as indicated 
by the HANDLER column, and further to a piece of in- $ 
formation with HL_index number 1 tn the hyperlink table 
304 as indicated by the "script" column. Such pieces of 
information in the NVT related to each other make up a 
piece of navigation information. 

Bit map table 301 of NVT[1] shown in FIG. 3 is com- w 
posed of bitmap 1 used as an icon indicating "NEW 
MOVIE INFORMATION." bitmap 2 as an icon indicating 
"INTERNET LATEST INFORMATION." bitmap 3 as an 
icon indicating "EVENT INFORMATION." bitmap 4 as 
an icon indicating "PROGRAM PREVIEW." and bitmaps 
101 -1 04 which are copies of bitmaps 1 -4 and are high- 
lighted. 

The bit map table of NVT[2] shown in FIG. 4 is com- 
posed of bitmap 5 used as an icon indicating "THE TER- 
ROR OF THE HUGE TORNADO (DISTRIBUTED BY 
AAA COMPANY)." "THE RETURN OF THE MON- 
STROUS DINOSAURS (DISTRIBUTED BY BBB COM- 
PANY)." "SPORTS WARS (DISTRIBUTED BY AAA 
COMPANY)," and "RETURN." and bitmaps 105-108 
which are copies of bitmaps 5-3 and are highlighted. 

While each of the bitmap tables of NVT[1 ] and NVT 
[2] includes four pieces of bitmap information, some bit- 
map tables include as many as 10 pieces of bitmap in- 
formation. NVT[12)shown in FIG. 5 provides an example 
of such a bitmap table 

Object definition table 302 is composed of a plurality 
pieces of object definition information which is used to 
define the icons included in the same NVT as objects. 
The object definition table 302 includes columns called 
"index " "type " "X-coordinate." "Y-coordinate " "HAN- 
DLER " "normal bitmap " and "focused Jd it map." 

The "index" column shows the index number of 
each piece of information included in the table. 

The "type" column shows the object type For ex- 
ample, each piece of information in the object definition 
table is specified as "Button" in the type column, which 
indicates that the icon has a characteristic as a button. 

The values in the "X-coordinate" and "Y-coordinate 1 * 
columns show the respective X and Y coordinates of the 
standard display position on the display screen. For ex- 
ample X and Y coordinates of navigation information! 1 ] 
are respectively x1 -50 and y!-50: X-and-Y coordinates 
of navigation informational are respectively x2=100 
and y2=50 The origin of the coordinate system is in the 
upper-left corner Bitmap 1 representing the "NEW so 
MOVIE INFORMATION" icon is displayed at a position 
specified by x1 =50 and y 1 =50. an upper-left position on 
the screen. Bitmap 2 representing the "INTERNET LAT- 
EST INFORMATION" icon is displayed at a position 
specified by x2 = 100 and y2=50. an upper-right position 55 
on the screen 

The "HANDLER" column points out an HDJndex 
number in the handler definition table 303. The mforma- 
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tion with the HD index number includes a script as 
shown in the "script" column which shows a link-target 
"content" by the HL index number in the hyperlink table 
304. where a "content" is composed of a NVT. a video 
element, and an audio element. 

The "normal_bitmap" column shows bit maps 
among those included in the bit map table which are dis- 
played normally on the screen 

The "focused_bitmap" column shows bit maps 
among those included in the bit map table which are dis- 
played highlighted on the screen. 

The handler definition table 303 includes columns 
called "HDJndex" and "script." 

The "HDJndex" column shows the HD_index 
number of each piece of information included in the ta- 
ble. 

The "script" column shows a script included in each 
piece of information included in the table. Every piece 
of information the handler definition table 303 shown in 
FIG 3 includes "goto_content" statement. The 
"goto_content" statement instructs the terminal appara- 
tus to fetch a piece of hyperlink information specified in 
the statement from the hyperlink table 304 and to obtain 
an NVT. video element, and audio element according to 
the hyperlink information. 

The hyperlink table 304 includes a column called 
"HL index" and 11 columns which are information ele- 
ments used to identify the link-target content. This is be- 
cause detailed information is required to specify a link 
target content among the vast amount of information 
provided in the digital broadcasting system. 

The "HL_index" column shows the HL_index 
number of each piece of information included in the ta- 
ble 

The "orig_nw_id" column shows which satellite is 
used to relay the link-target NVT. video element, and au- 
dio element. In other words the B ong_nw_id" column 
shows to which network the link-target NVT video ele- 
ment, and audio element belong 

The "ts_id" column shows which transport stream 
is used to transfer the link-target content. 

The "VE_svc_id" column shows to which TV pro- 
gram (service) the link-target video element belongs 
among a plurality of TV programs included in the trans- 
port stream 

The "VE_event_id" column shows to which broad- 
casting-channel (event) the TV programof the link-target 
video element belongs 

The "VE_comp jag" column shows which compo- 
nent tag is attached to the link-target video element, 
where the component is a stream identified by a PID 
(packet identifier) as defined in the MPEG2 standard. In 
the present embodiment, a video element or an audio 
element may be a component since each of these ele- 
ment includes its own PID. In case a group of video el- 
ements or audio elements are assigned one PID the 
group is regarded as one component. 

The fl AE_svc jd" column shows to which TV pro- 
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gram (service) the link-target audio element belongs 
among a plurality of TV programs included in the trans- 
pen packet. 

The "AE_event_id" column shows to which bread- 
casting channel (event) the TV program including of the 
link-target audio element belongs 

The "AE_comp_tag" column shows which compo- 
nent tag is attached to the link-target audio element 

The "NE_svc_id" column shows to which TV pro- 
gram (service) the link-target NVT belongs among a plu- 
rality of TV programs included in the transport stream. 

The "NE_event_id" column shows to which broad- 
casting channel (event) the TV program of the link-target 
NVT belongs. 

The "NE_id_EXT" column shows which table iden- 
tifier ("table jd_extension") is attached to the link-target 
NVT. 

The "rank" column shows a rank of the link-target 
video element, audio element, and NVT. the rank being 
determined by the broadcasting station according to the 
frequency of display or the like. In FIG 3. for example, 
a piece of information in the hyperlink table 304 with 
HLJndex number 1 (hereinafter, represented as 
HL_index[1]) has the highest rank, "2." followed by 
HL_index[2]. HL_index [3|. and HLJndex [4]. The rank 
may be determined according to answers to question- 
naires distributed by the broadcasting company, or ac- 
cording to fashions or topics in recent years. 

FIG. 6 shows the content of the PMT (Program Map 
Table). The PMT includes columns called "PID." 
"stream Jype." and "descriptor. u 

The "PID" column shows PlDs (Packet IDentrfiers). 

The "streamjype" column shows a type of each 
stream. 

The "descriptor" column shows a stream descriptor 
•stream_identifier_descriptor" including a component 
tag corresponding to each PID For example, stream de- 
scriptor "stream jdentifier_descriptor" including compo- 
nent tag "0x0002" is related to "PID0x0302 " Stream de- 
scriptor "stream identifier_descriptor" including compo- 
nent tag "0x0003" is related to *P! 00x0303 " The PMT 
is required for the terminal apparatus to obtain a P(D of 
a transport packet from a component tag of a link-target 
video element or a link-target audio element obtained 
from the hyperlink table 

A link-target NVT. video element, or audio element 
is obtained as follows based on the hyperlink table in 
NVT and PMT. 

<Specifying Link-Target NVT> 

The"HANDLER" column of the object definition ta- 
ble 302 in NVT specifies one HD Jndex number of the 
handler definition table 303 By referring to the script for 
the obtained HD index number, one HL_index number 
of the hyperfink table 304 is obtained. By referring to the 
*NE Jd_EXT" column of the table 304 the table identi- 
fier attached to the link-target NVT is obtained. 



1 -1 When bitmapl of NVT[1 1 related to the icon in- 
dicating "NEW MOVIE INFORMATION" is deter- 
mined: 

HLjndex "1 " -> NE Jd_E XT[Ox0002] NVT 
5 [2] including table identifier "0x0002" (refer to FIG. 

IB for NVT[2] with the table identifier) 

1- 2 When bitmap2 of NVT[1) related to the icon in- 
dicating "INTERNET LATEST INFORMATION" is 
determined: 

10 HLJndex "2" -* NE_id_EXT[0x0003] NVT 

[3] including table identifier "0x0003" (refer to FIG. 
1B) 

1 -3 When bitmap3 of NVT[1 ] related to the icon in- 
dicating "EVENT INFORMATION" is determined: 
is HL.index "3" -> NE_id„EXT[0x0004] NVT 

[4] including table identifier "0x0004" (refer to FIG. 
IB) 

1 -4 When bitmap4 of NVT[1 J related to the icon in- 
dicating "PROGRAM PREVIEW" is determined: 
20 HL.index "4" NE_id„EXT[0x0005| NVT 

(5) including table identifier "0x0005" (refer to FIG. 
1B) 

<Specifying Link-Target Video Element> 

25 

+ ■ 

The"HANDLER" column of the object definition* ta- 
ble 302 in NVT specifies one HD_index number ofjhe 
handler definition table 303 By referring to the script for 
the obtained HD index number, one HLJndex number 

30 of the hyperlink table 304 is obtained. By referring to the 
"VE_comp_tag" column of the table 304. the component 
tag attached to the link-target video element is obtained. 
By referring to the "descriptor" column of the PMT the 
PID attached to the link-target video element is. ob- 

35 tamed 

2- 1 When bitmapl of NVT[1] related to the icon in- 
dicating "NEW MOVIE INFORMATION" is deter- 
mined. 

-x> HL_index "1" VE.comp Jag[0x0002] 

PID[0x0302J VE[2| (refer to FIG. 1 B) 
2-2 When bitmap2 of NVT[1 j related to the icon in- 
dicating "INTERNET LATEST INFORMATION" is 

determined: 

J 5 HLjndex "2" VE,comp_tag[0x0003j 

P!D[0x0303) — VE[3] (refer to FIG. 1 B) 
2-3 When bitmap3 of NVT[1 ) related to the icon in- 
dicating "EVENT INFORMATION" is determined: 
HL_mdex3 VE_comp Jag[0x0004] — PID 

so [0x0304] — VE[4j prefer to FIG.1B) 

2-4 When bitmap4 of NVT[1 ] related to the icon in- 
dicating "PROGRAM PREVIEW" is determined: 

HL_index4 VE_compJag[0x0005| — * PID 
[0x0305] VE[5] (refer to FIG.1 B) 

55 

<Specifying Link-Target Audio Element> 

The"HANDLER" column of the object definition ta- 
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ble 302 in NVT specifies one HD_index number of the 
handier definition table 303. By referring to the script for 
the obtained HD index number one HLJndex number 
of the hyperlink table 304 is obtained. By referring to the 
" AE_comp_tag" column of the table 304. the component 
tag attached to the link-target audio element is obtained. 
By referring to the "descriptor" column of the PMT. the 
PID attached to the link-target audio element is ob- 
tained. 

2-1 When bitmap 1 of NVT[1] related to the icon in- 
dicating "NEW MOVIE INFORMATION" is deter- 
mined: 

HL_index "1* -> AE_comp_tag[0x01 02] -> 
PID[0x0602] -> AE[2] (refer to FIG 1 B) 
2-2 When bitmap2 of NVT[1] related to the icon in- 
dicating "INTERNET LATEST INFORMATION" is 
determined: 

HL_index "2" -> AE_comp_tag[0x0l 03] — 
PlD[Ox0603] -> AE[3] (refer to FIG 1 B) 
2-3 When bitmap3 of NVT[1 ] related to the icon in- 
dicating "EVENT INFORMATION* is determined: 

HL_index3 -> AE_comp_tag[0x0l04] -* PID 
[0x0604] -* AE[4] (refer to FIG. 1 B) 
2-4 When bitmap4 of NVT[1] related to the icon in- 
dicating "PROGRAM PREVIEW" is determined: 

HL_index4 AE_comp_tag[0x0l05] — PID 
[0x0605] AE[5] (refer to FIG. 1 B) 

As will be understood from the above description. 
NvT[1] specifies NVT[2]. VE[2]. and AE[2] as the link- 
targets. Such a group of a NVT a video element, and 
an audio element specified as link-targets are called a 
"content." A link-target content is specified by an NVT 
Then another link-target is specified by the NVT of the 
content. In this way. NVT-content relation is constructed 

FIG. 7 shows a tree structure formed with NVTs and 
"contents" in the present embodiment. The plurality of ar- 
rows shown in the drawing indicate the direction of the 
links Note that the root of the tree is called "root content. " 

FIG 7 indicates that content[1] includes VE[1] AE 
[1]. and NVT[1] (in the drawing. VE[1] and AE[1] is rep- 
resented as "VE_AE[1]." Hereinafter a combination of 
VE and AE included in a content is represented as 
"VE_AE"). This indicates that when presentation stream 
[i ] ;s decoded to generate a shot image the bit maps of 
NVT[1 j are superimposed on the shot image 

Similarly. content[2] includes VE[2]. AE[2]. and NVT 
[2j This indicates that when presentation stream[2] is 
decoded to generate an image of the preview of films 
the bit maps of NVT[2] are superimposed on the image 

A screen which is composed of an image generated 
from a presentation stream with icons superimposed on 
the image is called an interactive screen. FIGs.22A-22D 
show interactive screens FIG.22A. for example, shows 
an interactive screen which ts an image generated from 
presentation stream[1] with the icons of NVT[1] super- 
imposed on the image 



The transport stream constructed as shown above 
is repeatedly transmitted from broadcasting station 100 
to the terminal apparatuses, as shown in FIG.1A. Ac- 
cordingly, the terminal apparatuses can obtain neces- 
5 sary streams or tables. Note that the terminal appara- 
tuses must wait for each cycle period of the transmission 
for obtaining the necessary streams or tables. 

Now. a system for viewing programs which are 
broadcast with transport streams is described. FIG.8A 
10 shows an appearance of the viewing system which is 
composed of parabolic antenna 1, terminal apparatus 
2 TV receiver 3. and handy remote controller 4 

Parabolic antenna 1 which is set outside a house is 
used to receive carrier waves of the transport streams 
1 $ transmitted by the broadcasting satellite. 

Terminal apparatus 2 fetches transport streams 
from the carrier waves received by parabolic antenna 1 . 
and decodes the transport streams to NTSC or PAL im- 
age signals and stereo audio signals (hereinafter a 
20 combination of an image signal and an audio signal is 
called an AV signal). 

TV receiver 3 outputs images and voices according 
to the AV signals decoded by terminal apparatus 2. 
Handy remote controller 4. while TV receiver 3 out- 
25 puts images and voices, receives instructions from the 
operator and outputs infrared ray signals representing 
the received instructions to terminal apparatus 2. 

FIG. SB shows the keys arranged on handy remote 
controller 4. Handy remote controller 4 includes cross 
30 key 41 for moving the cursor, ten keys 42 for specifying 
numerals for selection, and enter key 43 for determining 
icons and the like. 

The construction of the terminal apparatus ts de- 
scribed with reference to FIG. 9 The terminal apparatus 
35 is composed of demodulator 1 0 TS decoder 1 1 AV de- 
coder 12. AV decoder controlling unit 13. navigation 
cache unit 14. presentation cache unit 1 5 operation de- 
tecting unit 16 cache manager 17 statistics table stor- 
ing unit 1S mode managing unit 19 cache table storing 
■to unit 20. cache processing unit 21. input switching unit 
22. graphic storing unit 23. graphic displaying unit 24. 
and browser 25 

Demodulator 1 0 demodulates a carrier wave which 
is sent from the broadcasting station and is received by 
the CS antenna to obtain transport packets and out- 
puts the obtained transport packets to TS decoder 11 . 

TS decocer 11 separates the transport -packets 
which belong ;o the video elementary stream or the vid- 
eo elementary stream from those output by demodulator 
50 1 o. and outputs the separated transport packets to input 
switching unit 22 at the side of AV decoder 12. When a 
table identifier is specified from browser 25. TS decoder 
11 detects a transport packet which has the specified 
table identifier among the plurality of transport packets 
55 of the table sub-stream, and outputs the detected trans- 
port packet ic cache processing unit 21 at the side of 
browser 25 

AV decoder 1 2. when input switching unit 22 outputs 
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a transport packet of video elementary stream or video 
elementary stream and a PID is specified by the AV de- 
coder controlling unit 13. decodes the transport packet, 
the video element, and the audtc element to generate 
an AV signal synchronizing them with PCR. In generat- * 
ing the AV signal by decoding., when browser 25 outputs 
the bit maps included in an NVT and when AV decoder 
controlling unit 13 instructs AV decoder 12 to superim- 
pose the bit maps on the image. AV decoder 1 2 super- 
imposes the bit maps output from browser 25 onto the » 
decoded image, and outputs the combined image to an 
AV terminal of the TV receiver as the AV signal. 

AV decoder controlling unit 13. when browser 25 
outputs a PID and an instruction for decoding the video 
element and audio element corresponding to the PID ; 
instructs AV decoder 1 2 to decode the video element 
and the audio element by referring to the PID. When 
browser 25 outputs an instruction for superimposing the 
bit maps onto the image of the video element. AV de- 
coder controlling unit 1 3 instructs AV decoder 1 2 to su- 
perimpose the bit maps onto the image of the video el- 
ement. AV decoder controlling unit 13 also instructs AV 
decoder 12 to change the color of a part of the bit maps 
in display if browser 25 instructs so. 

Navigation cache unit 14. which include memories 
enabling high-speed access, stores, among a plurality 
of NVTs included in transport streams, every NVT which 
has bit maps that may be displayed and all the NVTs 
whose bit maps having been displayed. Navigation 
cache unit 14 includes storage areas for storing NVTs. 
the storage areas having sequence numbers 1 . 2. 3, 4. 
5. and 6 and display history marks for indicating whether 
the bit maps of the stored NVT are displayed (hit or 
missed). 

FIG.10A shows the contentof navigation cache unit 
14 when the interactive screen shown in FIG.22A is dis- 
played. As shown in FIG.22A. the interactive screen dis- 
plays icons inditing "NEW MOVIE INFORMATION." 
"INTERNET LATEST INFORMATION." "EVENT IN- 
FORMATION." and "PROGRAM PREVIEW. " waiting for 
the operator to input instructions for moving the cursor 
or for determining a selected icon. According to the con- 
tent of navigation cache unit 14. it is recognized that 
NVT[1 ] whose icons are currently displayed has a mark 
indicating a hit. The drawing also indicates that naviga- 
tion cache unit 14 has already stored NVT[2]. NVT[3]. 
NVT[4]. and NVT[5]. Those NVTs are specified by the 
handler definition table 303 and hyper table 304 of NVT 
[1 ]. When the operator determines one out of the icons 
indicating "NEW MOVIE INFORMATION." "INTERNET 
LATEST INFORMATION." "EVENT INFORMATION." 
and "PROGRAM PREVIEW." the corresponding one out 
of NVTs[2]-[5] is displayed on the screen. 

As will be understood from the above description, 
navigation cache unit 14 stores NVT[2] NVT [3]. NVT 
[4]. and NVT[5] whose bit maps may be displayed next 
after the current screen shown m FIG.22A. 

FIG 1 0D shows the content of navigation cache unit 



1 4 when the interactive screen shown in FIG 22B is dis- 
played. As shown in FIG.22B. the interactive screen dis- 
plays icons indicating "THE TERROR OF THE HUGE 
TORNADO {DISTRIBUTED BY AAA COMPANY)/' 
» "THE RETURN OF THE MONSTROUS DINOSAURS 
(DISTRIBUTED BY BBS COMPANY)." "SPORTS 
WARS (DISTRIBUTED BY AAA COMPANY* - and "RE- 
TURN." waiting for the operator to input instructions for 
moving the cursor or for determining a selection. Ac- 
o cording to the content of navigation cache unit 14. it is 
recognized that NVT[1 ] whose bit maps having been 
displayed and NVT[2] whose bit maps are currently dis- 
played respectively have a mark indicating a hit. The 
drawing also indicates that navigation cache unit 1 4 has 
'5 already stored NVT[11]. NVT[12]. and NVT[21]. Those 
NVTs are specified by the handler definition table and 
hyper table of NVT[2], That is. navigation cache unit 14 
stores NVT[1 1 ]. NVT[1 2]. and NVT[21 ] that may be dis- 
played next after the current screen shown in FIG.22B. 
20 FIG . 1 0G shows the content of navigation cache unit 

1 4 when the interactive screen shown in FIG.22C is dis- 
played. The interactive screen including the bit maps of 
NVT[12] is shown in FIG.22C. According to the content 
of navigation cache unit 14. it is recognized that NVT 
25 [12] whose bit maps are currently displayed has a mark 
indicating a hit. The drawing also indicates that naviga- 
tion cache unit 14 has already stored NVT[41 ] NVT[42]. 
NVT[43l, and NVT[44]. NVTs [41 ]-[44] are specified by 
the handler definition table and hyper table of NVT[12]. 
so That is. navigation cache unit 14 stores NVTs [41 1-[441 
that may be displayed next after the current screen 
shown in FIG 22C. . . 

Note that the procedure for storing the above NVTs 
in navigation cache unit 14. as shown in FiGs.10A._i 0D. 
35 and 10G. will be described later 

Presentation cache unit 1 5 is a memory as naviga- 
tion cache unit 1 4. enabling high-speed accesses Pres- 
entation cache unit 1 5 stores, among a plurality ot pres- 
entation streams included in transport streams, every 
40 presentation stream which has a possibility of being dis- 
played and all the presentation streams having been 
displayed. Navigation cache unit 1 5 includes storage ar- 
eas for storing presentation streams, the storage areas 
having sequence numbers 1 . 2. 3. 4. 5. and 6 and dis- 
45 play history marks for indicating whether each stored 
presentation stream is displayed (hit or missed) Each 
of the storage areas also has identification information 
indicating how image information is storea in the storage 
area, that is. whether the whole image is stored or 
50 whether only the first frame is stored 

FIG. 11 A shows the content of presentation cache 
unit 15 when the interactive screen shown in FIG.22A 
is displayed. According to the content of presentation 
cache unit 15 it is recognized that currently displayed 
55 presentation stream[1 1 has a mark indicating a hit. The 
drawing also indicates that presentation cache unit 15 
has already stored presentation stream[2] presentation 
stream[3|. presentation stream[4] ; and presentation 
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stream[5) Those presentation streams are specified by 
the handier definition table and hyper table of NVT[1]. 
When the operator determines one out of icons indicat- 
ing "NEW MOVIE INFORMATION." "INTERNET LAT- 
EST INFORMATION." "EVENT INFORMATION." and 5 
"PROGRAM PREVIEW." the corresponding one of 
presentation streams[2]-[5J is displayed on the screen. 

As will be understood from the above description, 
presentation stream cache unit 1 5 stores presentation 
stream[2). presentation stream[3]. presentation stream 10 
[4], and presentation stream[5] that may be displayed 
next after the current screen shown in FIG 22A. 

FIG.11D shows the content of presentation cache 
unit 15 when the interactive screen shown in FIG.22B 
is displayed According to the content, it is recognized '5 
that presentation stream[1] having been displayed and 
presentation stream[2] currently displayed respectively 
have a mark indicating a hit. The drawing also indicates 
that presentation cache unit 1 5 has already stored pres- 
entation strearn[11]. presentation stream[l2] : and pres- 20 
entation stream[2l]. That is. presentation cache unit 15 
stores presentation stream[11]. presentation stream 
[12], and presentation stream[2 1 ] that may be displayed 
next after the current screen shown in FIG.22B. Those 
presentation streams are specified by the handler defi- 25 
nition table and hyper table of NVT[2] 

FIG.11G shows the content of presentation cache 
unit 15 when the interactive screen shown in FIG.22C 
is displayed According to the content, it is recognized 
that presentation cache unit 1 5 has already stored pres- & 
entation streams[41 ]-[44]. That is. presentation cache 
unit 1 5 stores presentation streams[41 ]-[44] that may be 
displayed next after the current screen shown in FIG. 
22C. Those presentation streams are specified by the 
handler definition table and hyper table of NVT[12] ^ 

Operation detecting unit 16 receives an infrared ray 
signal from handy remote controller 4 and detects an 
operation mstru^on from the received infrared ray sig- 
nal. The opera;: -,: instruction specifies such operations 
as follows, moving the cursor (when cross key 41 is +0 
pressed): and determining an icon (when enter key 43 
is pressed) Operation detecting unit 16 outputs the de- 
tected operation instruction to browser 25. 

Cache manager 17. when an icon is determined on 
the current screen and the next interactive screen is dis- 
played, obtains a plurality of contents that may be dis- 
played afier the "next interactive screen " Cache man- 
ager 17 while operation detecting unit 16 waits for an 
operation instruction to be input on the "next interactive 
screen. " instructs TS decoder 1 1 to receive presentation *o 
streams and NVTs with higher ranks to be displayed 
which have not been stored in navigation cache unit 14 
or presentation cache unit 15 and instructs cache 
processing unit 21 to store the received presentation 
streams in presentation cache unit 15 and to store the ? 5 
received NVTs in navigation cache unit 14. 

The presentation streams and NVTs that may be 
displayed next are determined by cache manager 1 7 as 
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follows: cache manager 17 refers to the hyperlink table 
of the current N VT to determine the link-target contents 
namely interactive screens that may be called from the 
related icons being displayed, then determines the pres- 
entation streams and NVTs belonging to the contents. 

The presentation streams and NVTs with higher 
ranks to be displayed are determined as follows, cache 
manager 17 determines these presentation streams 
and NVTs based on (1) the statistics table showing the 
frequency in determination for each presentation stream 
and NVT (2) the "rank" column in the hyperlink table of 
NVTs, (3) the icon currently in focus. 

The presentation streeams and NVTs with higher 
ranks need be determined since some NVTs may in- 
clude as many icons as cannot be stored in navigation 
cache unit 14. It is required that as many icons as can 
be stored in navigation cache unit 14 are selected 
among those included in such NVTs. This is the same 
for presentation cache unit 15. 

Suppose the maximum number of NVTs and pres- 
entation streams that can be stored in navigation cache 
unit 14 and presentation cache unit 15 is five respec- 
tively. In this case, the link-target presentation streams 
[2]-[5] and NVTs[2]-[5] of NVT[1] can respectively be 
stored in navigation cache unit 14 and presentation 
cache unit 15. On the other hand all of the link-target 
presentation streams[41 ]-[49] and NVTs[41 ]-[49] of 
NVT[12] cannot be stored in navigation cache unit 14 
and presentation cache unit 15. Thus, the necessity for 
selecting NVTs and presentation streams. 

In addition presentation streams and NVTs which 
have not been stored in navigation cache unit 14 or pres- 
entation cache unit 15 are selected. This is because 
once a presentation stream or an NVT is stored in each 
unit it is not deleted and kept to be stored (this will be 
described later) Accordingly this operation is per- 
formed not to repeat the same operation of storing pres- 
entation streams or NVTs in the units. 

The maximum number of NVTs and presentation 
streams that can be stored in navigation cache unit 14 
and presentation cache unit 15 are determined based 
on the time required to store all the NVTs and presen- 
tation streams This is because NVTs and presentation 
streams are repeatedly sent and that receiving a desired 
data takes as much wait time as the cycle period of rep- 
etition The wait time increases as the number of NVTs 
and presentation streams to be received increases 
Therefore, it may happen that the storing of NVTs and 
presentation streams does not end if the number is too 
great. As a result, it is desirable to calculate the wait time 
and to limit the number of NVTs and presentation 
streams to be stored not to exceed the presumed wait 
time 

Statistics table storing unit 18 stores the statistics 
table that shows the frequency in determination for each 
presentation stream and NVT FIG 1 2 shows a statistics 
table stored in statistics table storing unit 13 As shown 
in FIG. 12. the statistics table includes the statistics val- 
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ue for each NVT which is the number of determinations 
of the past. Sote that the mean vatue on datly basis or 
time-of-the-oay basis or standard deviation may be 
used instead of the number of determinations. 

Mode managing unit 19 manages the cache mode 5 
which indic^es the best one among (1) the statistics 
table. (2) the "rank" column in the hyperlink table, and 
(3) the icon currently in focus so that the best cache 
mode is used by ; <che manager 17 in generating the 
cache table Mode managing unit 1 9 changes the cache to 
mode according to the state of the terminal apparatus. 

Cache table storing unit 20 stores the cache table 
generated by cache manager 17 

Cache manager 17 determines the presentation 
streams and NVTs to included in the cache table based 15 
on (1) the statistics table. (2) the "rank" column in the 
hyperlink table, and (3) the icon currently in focus, and 
generates the cache table. FIGs.13A-13C show cache 
tables. 

FIG.13A shows a cache table which is generated 20 
based on the statistics table shown in FIG . 1 2. The cache 
table shows the highest ranking link-target contents 
among those specified in the hyperlink table of N VT[ 1 2]. 

FIG.13B shows a cache table which is generated 
based on the "rank" column in the hyperlink table shown 25 
in FIG.5C The cache table shows the highest ranking 
link-target content among those specified in the hyper- 
link table of NVT[12], 

FIG.13C shows a cache table which is generated 
based on the icon currently in focus. More specifically. 30 
when a plurality of icons are displayed on the current 
screen, the possible link targets for each icon currently 
displayed are evaluated by weighting the icon in focus 
with the highest value and by weighting icons adjacent 
to the icon m focus with the second highest value, 35 

While the cache table shown in FIG 1 3A includes 
contents[4l]-[45). the cache table shown in FIG 13B in- 
cludes contents[45j. [47]. [461. [43], and [44]. This ex- 
ample indicates that the contents of the cache table may 
greatly change depending on the cache mode. 40 

Cache processing unit 21 manages the start ad- 
dress and end address of each area in navigation cache 
unit 14 and presentation cache unit 15. Cache process- 
ing unit 21 increases or decreases the capacity of each 
area in navigation cache unit 1 4 and presentation cache -5 
unit 15 according to the size of the NVT or the presen- 
tation stream to be stored in the area. In doing so cache 
processing unit 21 also performs writing, reading, or a 
garbage collection. 

In the writing, cache processing unit 21 writes an so 
NVT output from TS decoder 11 and a presentation 
stream output from input switching unit 22 respectively 
in navigation cache unit 14 and presentation cache unit 
15 at areas closer to the start of each unit. 

Cache processing unit 21 . on receiving a read re- 55 
quest from cache manager 1 7. reads the requested NVT 
or presentation stream from navigation cache unit 14 or 
presentation cache unit 15. then outputs the read NVT 



to browser 25 and the read presentation stream to input 
switching unit 22. 

In the garbage collection, cache processing unit 21 
puts a mark indicating a hit on a presentation stream or 
an NVT when the presentation stream or the NVT is dis- 
played: cache processing unit 21 deletes the rest of the 
presentation streams or NVTs. When free areas exist 
between the areas for the hit presentation streams or 
NVTs. cache processing unit 21 moves the hit presen- 
tation streams or NVTs so that free areas are arranged 
in sequence. 

Input switching unit 22 transfers the transport pack- 
ets of the video elementary stream and the video ele- 
mentary stream received by TS decoder 11 to AV de- 
coder 12. Input switching unit 22 transfers the transport 
packets of the video elementary stream and the video 
elementary stream to presentation cache unit 15 when 
Input switching unit 22 receives a switch instruction from 
cache manager 1 7 for switching the transfer target from 
AV decoder 12 to presentation cache unit 15 

Input switching unit 22. on receiving a switch in- 
struction from cache manager 1 7 for using the transport 
packets in presentation cache unit 15. reads the trans- 
port packets from presentation cache unit 15 and trans- 
fers the read transport packets to AV decoder 12 V _. 

Graphic storing unit 23 stores the bit map for inform* 
ing the operator of a display break In this embodiment, 
the bit map represents a character sequence indicating 
"WAIT FOR A MOMENT." 

Graphic displaying unit 24 outputs the character se- 
quence indicating "WAIT FOR A MOMENT" stored in 
graphic storing unit 23 to AV decoder 12 when there is 
no NVT with a bit map that can be displayed 

Browser 25 fetches PlDs of link-target video ele- 
ment and audio element by referring to the hyperlink ta- 
ble and PMT based on the above procedures: speci- 
fying Link-Target NVT> <Specifying Link-Target Video 
Elements and <Spectfying Link-Target Audio Ele- 
ments and outputs the fetched PlDs to AV decoder 1 2 
via AV decoder controlling unit 1 3. Browser 25 also in- 
structs AV decoder 1 2 to decode the video element and 
audio element related to the fetched PlDs to generate 
one AV signal. 

Browser 25. when TS decoder 11 outputs a trans- 
port packet of the NVT sub-stream, fetches bit maps 
from the transport packet and outputs the bit maps to 
AV decoder 12. with an instruction for combining the bit 
maps with the image Browser 25 executes a processing 
program included in the navigation information. With this 
execution, the bit maps are displayed on the screen. 
Browser 25 instructs AV decoder controlling unit 13 to 
change the color of icons when the operator performs a 
cursor move operation. 

Now. the operation of the terminal apparatus is de- 
scribed below with reference to flowcharts shown in 
FIGs. 1 4-1 7 on cache manager 1 7 and in FlGs. 1 6-21 on 
browser 25. This is because cache manager 17 and 
browser 25 take important parts among the above men- 
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tioned components in the operation of the terminal ap- 
paratus which is mainly achieved by software. 

In step S51 of the flowchart shown in FIG. 1 4. cache 
manager 17 sets variable p to the root number. Here : 
the variable p indicates an index number of a "content. 
" NVT video element, or audio element to be read, and 
the root number indicates an index number of a "con- 
tent." NVT. video element, or audio element which is at 
the root of the tree structure which is uniquely defined 
by PAT and PMT In the present example shown in FIG. 
7 the root number is specified as "1 " 

Suppose variable p is set to "1 " in step S51 . In step 
S52. demodulator 10 and TS decoder 11 receive pres- 
entation streamfp] and NVT[p] and store them in pres- 
entation cache unit 15 and navigation cache unit 14 re- 
spectively. 

Step S53 is described in detail tn the flowchart 
shown in FIG. 15. Note that the flowcharts shown in 
FIGs.15-17 show processing procedures for the con- 
tents one generation later than content(p). Here, "the 
contents one generation later than content^]" indicates 
that content[p] links to "the contents one generation later 
than content[p]" in the tree structure in which a content 
is linked from the NVT of the previous content. In this 
case, contents one generation later than content[1] are 
contents[2]. [3]. [4] and [5]. Similarly, contents two gen- 
erations later than content[1 ] are contents[1 1 ] ; [12]. [21 ]. 
[22]. [23]. [32] ... as shown in FIG. 7. 

In step S60 of FIG. 15. initial values are set for the 
index number and the cache end flag Here index 
number is a variable specifying each content in the 
cache table. Suppose in the present embodiment, the 
initial value of the index number is set to "1 When the 
cache end flag is "1 ." it indicates that the NVT and pres- 
entation stream have been stored. When the cache end 
flag is "0." tt indicates that the NVT and presentation 
stream have not been stored Suppose in the present 
embodiment, the initial value of the cache end flag is set 
to "1." Note that in the following description, each of a 
plurality pieces of information included in one NVT is 
represented as "NVTNAVI " 

Step S61 is described in detail in the flowchart 
shown in FIG. 16. 

In step S77 of FIG. 16. cache manager 17 obtains a 
cache mode which is managed by mode managing unit 
19 

In step 373. it is judged whether the cache mode is 
that of statisucs value If it is judged as yes control goes 
to step ScO In step S30. s higher ranking contents 
among those ranging from content(NVT[p].NAVI 
[START] link destination) to content(NVT[p].NAVI 
[END], link destination) are registered in the cache table 
based on the statistics value 

If it is judged as no in step S78. control goes to step 
S79 In step S79. it is judged whether the cache mode 
is that of the "rank" column in the hyperlink table If it is 
judged as yes. control goes to step Set . In step SS1 . s 
higher ranking contents among the contents from con- 



tent(NVT[p] NAVi[START].link destination) to content 
(NVT[p].NAVI[END].link destination) are registered in 
the cache table, based on the "rank" column in the hy- 
perlink table. 

5 If it is judged as no in step S79. control goes to step 

S32 In step S82. the cache table is generated m which 
a content including the icon currently in focus is deter- 
mined as rank 1 : a content including an icon in the right 
or left hand side of the icon in focus is determined as 

to rank 2: a content including an upper or lower icon of the 
icon in focus is determined as rank 3: and a content in- 
cluding an icon in a slanting direction from the icon in 
focus is determined as rank 4. 

Note that in an initial stage after the terminal appa- 

is ratus has been activated, a substantially effective rank- 
ing cannot be expected for the cache modes of statistics 
value and the icon currently in focus. Accordingly, the 
initial cache mode is set to that of the "rank" column in 
the hyperlink table by mode managing unit 19 Thus, in 

20 the present embodiment, it is judged as no in step S73 
and yes in step S79. and control goes to step S81 

In step S81. s higher ranking contents among the 
contents from content(NVT[p].NAVI[START].lmk desti- 
nation) to content(NVT[pJ.NAVI[END).link destination) 

25 based on the "rank" column in the hyperlink table are 
registered in the cache table. More specifically, four 
higher ranking contents among the contents from con- 
tent(NVT[1 ].NAVI[START]. content [2]) to content(NVT 
[p].NAVI[END].content[5]). determined based on the 

30 "rank" column in the hyperlink table, namely contents 
[2]-[5], are registered in the cache table in the order of 
the ranking. From steps of the flowchart shown in FIG 
16. control returns to step S62 in the flowchart of FIG . 1 5 
In step S62. content[q] in the cache table at the po- 

35 sition of the index number is obtained. Suppose the 
cache table generated through the procedures of FIG 
16 includes contents[2j. [3]. [4]. and [5]. Since in this 
case the index number is "1." the first content in the 
cache table, namely content[2] is obtained by cache 

-to manager 1 7 Then in step S63. variable q is substituted 
for variable p. In step S64. NVT[p] video element[p]. 
audio eiement[p], and the PCR of content[p] are ob- 
tained. 

In step S65. it is judged whether navigation cache 
J 5 unit 14 includes a free area with enough capacity for 
storing NVT[p] If not control goes to step S67 In step 
S6 7 NVT[p] ts stored in a marked area storing the oldest 
NVT. In the present case, since variable p is "2" and nav- 
igation cache unit 14 includes a free area with enough 
so capacity for storing NVT[2[ it is judged as yes in step 
S65. allowing the control to go to step S66. In step S66. 
NVT[2] is stored in navigation cache unit 14. 

in step S83 in the flowchart of FIG. 17. the PIDs of 
video element[p] and audio elementfp] of presentation 
55 stream[p] are obtained. Then, in step SS4. the obtained 
PIDs are set in the TS decoder, input switching unit 22 
changes the destination of the output from input switch- 
ing unit 22 to presentation cache unit 1 5. then Video el- 
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ement[p] and audio element(p) are output to input 
switching una 22. In this way. transport packets of the 
video elementary stream and video elementary stream 
start to be received Cache manager 1 7 judges whether 
presentation cache unit 15 includes a free area with 
enough capacity for storing presentation stream[p] in 
step S85. 

In the present case, since variable p is "2." and pres- 
entation cache unit 15 includes a free area with enough 
capacity for storing NVT[2]. it is judged as yes in step 
S85. allowing the control to go to step S86. In step S86. 
cache manager 17 stores presentation stream[2) in 
presentation cache unit 1 5. 

If it is judged as no in step S85. control goes to step 
S95. In step S95. it is judged whether presentation 
cache unit 1 5 includes a free area with enough capacity 
for storing the first frame of presentation stream[p]. If 
judged as yes. control goes to step S96. In step S96. 
the first frame is stored in presentation cache unit 15. 

If judged as not in step S95. control goes to step 
S97. In step S97. the first frame of presentation stream 
[p] is stored in a marked area of presentation cache unit 
15 storing the oldest presentation stream, then control 
goes to step S92 ~ 

As will be understood from the above description, 
as many whole presentation streams as possible are 
stored in presentation cache unit 15 if presentation 
cache unit 1 5 has enough capacity: only the first frames 
of presentation streams are stored in presentation 
cache unit 15 if presentation cache unit 15 does not 
have enough space for storing a whole presentation 
stream. 

Accordingly, high ranking presentation streams are 
stored in presentation cache unit 15 while presentation 
cache unit 15 has enough capacity. That means the 
whole video elements of the high ranking presentation 
streams are stored in presentation cache unit 1 5. In con- 
trast, for low ranking presentation streams, only the first 
frames the video elements of the low ranking presenta- 
tion streams are stored in presentation cache unit 15 
This ts because there is a low possibility for the low rank- 
ing presentation streams to be displayed. 

In step s92. the index number is incremented by 
one In step S90. it is judged whether a content is reg- 
istered in the cache table at the position of the index 
number If judged as yes. control gees to step S93 in 
which the cache end flag is set to "1." then control re- 
turns to step S54. if judged as yes in step S90. control 
goes to step 562 to enter the second cycle of the pro- 
cedure. 

In step S62 of the second cycle. content[q] in the 
cache table at the position of the index number is ob- 
tained. In the present case, the index number is current- 
ly "2" since the value has been incremented by one in 
step S92. Accordingly, the second content in the cache 
table, namely. content[3] is obtained here Then, in step 
S63. variable q (currently. 3) is substituted for variable 
p. In step S64. NVT[3] video element^, audio element 



[3]. and the PCR of conter;[3] are obtained. 

Suppose in step S66 NVT[3] is stored in navigation 
cache unit 14 as the third NVT. Also suppose presenta- 
tion stream[3] including vceo element[3] and audio el- 

5 ement(3] is stored in presentation cache unit 15 as the 
third presentation stream The index number is incre- 
mented by one again in siep S92. then control goes to 
step S62 of the third cycle 

In step S62 of the third cycle, content[q] in the cache 

io table at the position of the index number is obtained. 
Since the index number is currently "3." the third content 
in the cache table, namely content[4] is obtained here. 
Then, in step S63. variable q {currently. 4} is substituted 
for variable p. Then, in step S64. NVT[4]. video element 

'5 [4]. audio element[4). and the PCR of content[4) are ob- 
tained. 

Suppose in step S66 NVT[4] is stored in navigation 
cache unit 1 4 as the founn NVT Also suppose presen- 
tation stream[4] including video element[4] and audio el- 

20 ement[4] is stored in presentation cache unit 15 as the 
fourth presentation stream The index number is incre- 
mented by one again in step S92, then control goes to 
step S62 of the fourth cycle. 

In step S62 of the fourth cycle. content[q] in the 

25 cache table at the positton of the index number is ob- 
tained. Since the index number is currently "4^' the 
fourth content in the cacne table, namely. content[5j is 
obtained here Then, in seep S63. variable q (currently. 
5) is substituted for variable p. Then, in step S64. NVT 

30 [5]. video efement[5I : audio element[5]. and the PCR of 
content[5] are obtained 

Suppose in step S66 NVT[5) is stored in navigation 
cache unit 14 as the fifth NVT Also suppose presenta- 
tion stream[5j including video element[5] and audio el- 

35 ement[5] ts stored in presentation cache unit 15 as the 
fifth presentation stream The index number ^"'incre- 
mented by one again in step S92. This time, it is 'judged 
as no in step 390. As a insult, control goes to step S93 
in which the cache end vag is set to M 1 ." and control re- 

-fO turns to step 354 shown in FIG. 14. 

In step S54. it is judged whether an input of an op- 
eration instruction is waited for on the interactive screen. 

If judged as yes in step S54. contro\ goes to step 
S55. fn step S55. content [i] corresponding to the current 

J 5 interactive screen is identified. The variable t indicates 
the index number of the content currently displayed in 
the interactive screen ""en in step S56 the icon being 
in fucus namely. "NVT\] NAVI[mJ" is identified, where 
variable m indicates an ndex number of a piece of nav- 

50 igation information including a bit map of the icon being 
in focus in NVT[i). Suppose the interactive screen shown 
in FIG 22A is currently displayed and the icon indicating 
"NEW MOVIE INFORMATION" is in focus. Under this 
condition. content[1] is identified in step S55. and "NVT 

55 [1 1 NAV!(1 1" is identified in step S56 

In step S57. a link-target content[k] specified by the 
hyperlink information o; navigation information "NVT[i]. 
NAVI[mI" is obtained Then, in step S59. variable k is 
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substituted for variable p Control returns to step S53 so 
that "the contents one generation later than content[p]" 
are read. 

In the present case, link-target content[2] specified 
by the hyperlink information of navigation information 
"NVT[1] NAVi[1]" is obtained Then, in step S59. varia- 
ble k (currently 2) is substituted for variable p. Control 
returns to step S53 so that "the contents one generation 
later than content[2]* are read. In step S53 ; contents 
[11]. [12]. and [21] are read 

Now : the operation of the terminal apparatus is de- 
scribed with reference to the flowcharts shown in FIGs. 
18-21 related to browser 25. 

After the terminal apparatus is activated, browser 
25 sets variable i to the root number in step S2 shown 
in FIG. 13. In step S3 NVT[i] ; video element[i] T and audio 
element[i] are obtained. In step S4. the interactive 
screen generated from the obtained NVT[i]. video ele- 
ment^], and audio e!ement[i] is displayed. 

Step S4 is described in detail in the flowchart shown 
in FIG 1 9 

In the flowchart shown in FIG. 19. browser 25 oper- 
ates for switching the interactive screen at high speed. 

In step S21 it is judged whether presentation 
stream[i] is stored in presentation cache unit 15. If 
judged as yes. control goes to step S22. In step S22. 
cache processing unit 21 is instructed to read presen- 
tation stream[i] from presentation cache unit 15 In step 
S23. input switching unit 22 is instructed so that streams 
are distributed to AV decoder 12 from presentation 
cache unit 15 

If judged as no in step S21 . control goes to step S25 
In step S25. it is judged whether the first frame of pres- 
entation stream[i] is stored in presentation cache unit 
15 If judged as yes control goes to step S26. In step 
S26. cache processing unit 21 is instructed to read the 
first frame of presentation stream[i] from presentation 
cache unit 15 In step S27. input switching unit 22 is in- 
structed so that streams are distributed to AV decoder 
1 2 from presentation cache unit 1 5 In step S28. AV de- 
coder controlling unit 13 is instructed to issue the PIDs 
of video element[i] and audio element[i] to AV decoder 
12 and the first frame of presentation stream[i] in pres- 
entation cache unit 15 is displayed. 

If it is judged as no in step S25. control goes to step 
S29 In step S29 graphic displaying unit 24 outputs the 
character sequence indicating "WAIT FOR A MOMENT" 
stored in graphic storing unit 23 to AV decoder 12 so 
that the character sequence is displayed on the screen, 
the screen being displayed as a default screen. 

In step 530. input switching unit 22 is instructed so 
that streams are distributed to AV decoder 1 2 from TS 
decoder 11 

In step S24. AV decoder controlling unit 13 is in- 
structed so that the PIDs of video element[i] and audio 
eiement[i] are issued to AV decoder 12 With such an 
arrangement. AV decoder 1 2 decodes either of the pres- 
entation stream read from presentation cache unit 15 



and the presentation stream received by TS decoder * * 
using the PIDs sent from AV decoder controlling unit 1 3 
In step S31 shown in FIG. 20. it is judged whether 
NVT[i] is stored in navigation cache unit 1 4. If judged as 

s yes. control goes to step S32. In step S32. NVT[i] s 
fetched from navigation cache unit 14. 

If judged as not in step S31 : control goes to step 
S42. In step S42. an icon display instruction is issued :o 
graphic displaying unit 24. Graphic displaying unit 2<i 

10 on receiving this instruction, displays the character se- 
quence "WAIT FOR A MOMENT" stored in graphic stor- 
ing unit 23. as the default screen. 

In step S43. the table identifier of NVT[i] is output 
to the TS decoder In step S44, the TS decoder is uv 

'5 structed to receive NVT[i]. In step S45. it is judged 
whether N VT[i] has been received. If judged as yes. con- 
trol goes to step S46. 

In step S46. all the bit maps included in "NVTTi] 
NAVl [start]"- M NVT[i].NAVL[end] n are transformed for 

20 display. In step S47. the transformed bit maps are output 
to the AV decoder. In step S48. the AV decoder com- 
bines the transformed bit maps with the image which is 
the decoded presentation stream[i]. In step S49 shown 
in FIG. 21. it is judged whether NVT[i] has been stored 

25 jn navigation cache unit 14. If judged as yes. control 
goes to step S101. In step S101. the NVT[i] stored in 
navigation cache unit 14 is marked. If judged as nc in 
step S49. control goes to step S100 in which NVT[ij is 
stored in navigation cache unit 14 with a mark. 

30 in step S102. it is judged whether presentation 
stream[i] has been stored in presentation cache unit 15. 
If judged as yes. control goes to step S 104. In step S104. 
the presentation stream[i] stored in presentation cache 
unit 1 5 is marked. If judged as no in step S102. control 

35 goes to step S103 in which presentation stream^ is 
stored in presentation cache unit 15 with a mark. 

In step S106 the cache end flag is set to 0. In step 
S107 variable m is set to 1. In step S108. the bit map 
of N VT[i|. NAV[m j is made to be in focus Note that in ihe 

•to present embodiment, a bit map specified by the first 
piece of navigation information is made to be in focus 
However, a bit map specified by any piece of navigation 
information may be made to be in focus. Control returns 
to step S5 shown in FIG. 18. 

-5 in step S5. it is judged whether an operation instruc- 

tion has been input on the interactive screen If jucged 
as yes in step S5 by operation detecting untt 16 control 
goes to step S6 In step S6. it is judged whether the op- 
eration specified by the operation instruction is a deter- 

50 mination operation If judged as no. control goes to step 
S7 In step S7. it is judged whether the operation spec- 
ified by the operation instruction is a cursor move oper- 
ation. 

If judged as yes. control goes to step S3. In step 58. 
55 the state of being in focus is cleared for the bit map of 
NVT[i].NAVI[m]. In step S9. variable m is updated to in- 
dicate a link-target index number In step S10. the bit 
map of NVT[i].NAVI[m] is made to be in focus. Control 
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returns to step S5 

If it is judged th=: the input operation ts the determi- 
nation operation m s;ep S6. control goes to step S11.in 
step S11. the bit of NVT[i].NAVI[m] is made to be 
in the determinatior state. In step S1 2. a link-target con- 
tent^] specified by \VT[i]. NAVI[m] in the hyperlink table 
is obtained. In stec 513. NVT[k]. video element[k]. and 
audio elemental a- obtained In step S1 4. the statistics 
value for NVT[k] in :ne statistics table is incremented by 
one. In step S15. V is substituted for u i." In step S16. 
the presentation sreams and NVTs without marks are 
respectively deleted from presentation cache unit 15 
and navigation cacne unit 14. In step S18. it is judged 
whether the cache *nd flag is "1 ." Control stays at step 
S18 until the cache end flag is "1." This indicates that 
the next operation is not started until cache manager 1 7 
completely stores the presentation streams and NVTs 
one generation later into presentation cache unit 1 5 and 
navigation cache 'jnit 1 4 respectively In case the repro- 
duction of the presentation stream ends while the next 
operation is not sorted in the above process browser 
25 repeats reproduction of the presentation stream, 
keeps on displaying a still image of the last frame or the 
like. If it is judged as yes in step S15. control returns to 
S4. 

Now. the operation on the contents shown in FIG. 7 
is described, based on the above flowcharts. 

FIG.22A shows the interactive screen generated 
from N VT[1 ], videc elementp ]. and audio elementp ] in 
step S4 and is displayed on TV receiving unit 3. The 
interactive screen .s composed of a shot image gener- 
ated from presentation stream[1] and several icons su- 
perimposed on Xte shot image. The voice of an an- 
nouncer is outpu: While the interactive screen is dis- 
played, cache manager 17 obtains contents[2]. [3]. [4]. 
and [5] specified the handler definition table 302 and 
hyperlink table 304 of NVT[1] Then, presentation 
streams [2]. [3]. and [51 are stored in presentation 
cache unit 1 5 via demodulator 10 and TS decoder 11 
Similarly NVTs[2^ [3]. [4]. and [5] are stored in naviga- 
tion cache unit 14 via demodulator 10 and TS decoder 
11. 

Currently displayed presentation stream[1] and 
NVT[1] are marked respectively in presentation cache 
unit 15 and navigation cache unit 14 in steps 101 and 
104 FIG.10A arz FIG. 11 A respectively show the con- 
tents of navigate cache unit 1 4 and presentation cache 
unit 1 5 after the ?.aove operation 

When the ccsrator determines an icon indicating 
"NEW MOVIE INFORMATION" on the current screen, 
the processing gees through steps S11 to S13 and re- 
turns to step S4 an which browser 25 displays the inter- 
active screen generated from NVT[2] : video element[2]. 
and audio element^]. FIG 22B shows the interactive 
screen at this stage. 

Currently displayed presentation stream[2] and 
NVT[2] are marked respectively tn presentation cache 
unit 15 and navigation cache unit 14. in steps 101 and 



104 F'G 10B and FIG.11B respectively show the con- 
tents cf navigation cache unit 1 4 and presentation cache 
unit 15 after the above operation. 

After presentation stream[2] and NVT[2] are dis- 
s played as described above, areas without marks are de- 
leted trom navigation cache unit 14 and presentation 
cache unit 15. FIGs.lOC and 11C respectively show the 
contents of navigation cache unit 14 and presentation 
cache unit 15 after the above operation. 
w While the interactive screen is displayed, cache 

manager 17 obtains contents[H] : [12]. and [21] speci- 
fied in the hyperlink information of NVT[2]. Then, pres- 
entation streams[11], [12]. and [21] are stored in pres- 
entation cache unit 15 via demodulator 10 and TS de- 
is coder 11 . Similarly. NVTS[11] : [12], and [21] are stored 
in navigation cache unit 14 via demodulator 10 and TS 
decoder 11. FIGs.10D and 11D respectively show the 
contents of navigation cache unit 14 and presentation 
cache unit 15 after the above operation. 
20 Suppose the operator determines an icon indicating 

"THE TERROR OF THE HUGE TORNADO (DISTRIB- 
UTED BY AAA COMPANY)." Then, the processing goes 
through steps S1 1 to Si S and returns to step S4 in which 
browser 25 displays the interactive screen generated 
25 from NVT[12] : video element[l2], and audio element 
[12] FIG.22C shows the interactive screen displayed at 
this stage 

Currently displayed presentation stream[l2] and 
NVT[12] are marked respectively in presentationcaqhe 
30 unit 15 and navigation cache unit 14. in steps 101 and 
104 FIG.10E and FIG. 11 E respectively show the con- 
tents of navigation cache unit 1 4 and presentation cache 
unit 15 after the above operation. 

After presentation stream[l2] and NVT[12] are dis- 
35 played as described above, areas without marks are de- 
leted from navigation cache unit 14 and presentation 
cache unit 15. FIGs.lOF and 11 F respectively show the 
contents of navigation cache unit 14 and presentation 
cache unit 15 after the above operation. 
40 While the interactive screen is displayed, cache 
manager 17 obtains contents[41 ]-[49l specified in the 
hyperlink information of NVT[12]. Then, presentation 
streams[41 ]-[49] and NVTs[41 ]-[49] are attempted to be 
stored respectively in presentation cache unit 15 and 
45 navigation cache unit 14. However, as shown in FIGs. 
10F and n F. there are only two free areas m each of 
the cables. As a result presentation streams[4l] and 
[42: and NVTs[41] and [42] are stored in two areas, re- 
placing with two oldest presentation streams and NVTs 
50 respectively in presentation cache unit 15 and naviga- 
tion cache unit 14. Presentation streams[43| and [44] 
and NVTs[43] and [44| are stored in two free areas of 
presentation cache unit 1 5 and navigation cache unit 1 4. 
respectively. FIGs.lOG and 11G respectively show the 
55 contents of navigation cache unit 14 and presentation 
cache unit 15 after the above operation. 

Now. the operation corresponding to the determina- 
tion of "RETURN" icon is described. Suppose the oper- 
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ator determines an icon indicating "RETURN" in the in- 
teractive screen as shown in FIG.22B. By referring NVT 
[2]. it ts determined that the icon is related to the index 
number 4. and that the link-destination is content[1]. 

FIG. 1 0B and FIG.11B respectively show the con- 
tents of navigation cache unit 1 4 and presentation cache 
unit 15 at this stage As will be understood from the ta- 
bles shown in FIG lOBand FIG.11B, NVT[1] and pres- 
entation stream[1 ]. namely, the above link targets : have 
already been stored. Accordingly. NVT[1] and presen- 
tation stream[1 ] can immediately be obtained from these 
tables and displayed as the interactive screen as shown 
in FIG 22A. 

When the operator determines an icon indicating 
•NEW MOVIE INFORMATION" here the interactive 
screen shown in FIG 22B is immediately displayed 
since presentation stream[2] and NVT[2] are stored in 
presentation cache unit 1 5 and navigation cache unit 1 4 
with marks, respectively. As will be understood from the 
above description, the construction in which presenta- 
tion streams and NVTs are stored in presentation cache 
unit 15 and navigation cache unit 14 with marks 
achieves the high-speed return to the previous screen 
responding to the determination of the "RETURN" icon. 

As has been described above, the TV broadcasting 
system of the present embodiment enables an immedi- 
ate display of an interactive screen since the link-target 
NVT and presentation stream can immediately be ob- 
tained from navigation cache unit 14 and presentation 
cache unit 15 and displayed, responding to the determi- 
nation of one icon in the previous screen. 

The TV broadcasting system of the present embod- 
iment also enables storage of a plurality of presentation 
streams and NVTs which have possibility of being dis- 
played next m presentation cache unit 1 5 and navigation 
cache unit 14 in advance while the current interactive 
screen is displayed 

The above operation also has an effect that the op- 
erator does not recognize the storing of presentation 
streams and NVTs since the storage is done while the 
TV broadcasting system waits for an input of an opera- 
tion instruction on the currently displayed interactive 
screen <Second Embodiment 

The present embodiment achieves a TV broadcast- 
ing system which uses video elements including still pic- 
tures, white the TV broadcasting system of the first em- 
bodiment uses video elements which include only mo- 
tion pictures 

FiG.23 shows the contents of the transport streams 
broadcast in the present embodiment. Each of VE[0]. 
VE[1]. VE[2]. . includes still pictures. While in the first 
embodiment each video element has a different PID. in 
the second embodiment, each video element has a 
common PID whrch is "0x0084." as shown in FIG 23. 
This is because it is intended in the second embodiment 
that a large number of still pictures are broadcast and 
that the length of the PID is not enough for assigning a 
unique identifier to each video element. Though each 



video element has a common PID it has another iden- 
tifier called "stream_id." In FIG 23. for example. VE[0] 
has stream_id "OxeO," and VE[1 ] has stream_id "0xe1 
as well as a common PID. "0x0034." 

5 While in the first embodiment the transport stream 

is composed of a sequence of video elements, in the 
second embodiment, the transport stream includes a 
private section called video element table (VET) be- 
tween video elements. As shown in FIG.23, for example. 

io VET[15] is inserted in immediately before VE[0] : VET 
[16] in immediately before VE[1]. Similarly, the transport 
stream of the present embodiment includes a private 
section called audio element table (AET) between the 
audio elements. 

15 FiG 24A shows the content of VET[15]. VET[15] in- 

cludes an identifier called VE_id_extension whose val- 
ue is "0x0001 which is unique to VET[1 5]. VET[1 5] also 
includes a PID. "0x0083. " Though VET[15] is inserted 
in immediately before VE[0]. it has the stream_id "Oxef 

20 of VE[1 5] which is at a position about a dozen VEs away. 

F1G.24B shows the content of VET[16). VET[16] in- 
cludes VE_id_extension whose value is "0x0000." 
which is unique to VET[16]. VET[16] also includes the 
same PID. "0x0083," as that of VET[15). Though VET 

25 [16] is inserted in immediately before VE[1]. it has the 
streamed "OxeO" of VE[16] which is at a position about 
a dozen VEs away. In this way. each VET has the 
stream_id of a corresponding VE which is at a position 
a certain number of VEs away. 

30 FIG 25 shows a content of a hyperlink table in an 

NVT of the second embodiment. The hyperlink table of 
the second embodiment differs from that of the first em- 
bodiment in that it includes "VE_id„extension" 2547 in- 
stead of "VE^omp^ag" and "AE_id_extension n in- 

35 stead of "AE_comp_tag. " The "VE_id extension" column 
and *AE jd^extension" column respectively show a 
VE_id_extension of a VET and an AE_id_extension of 
an AET For example. H 0x0000" and "0x0001" included 
in "VE_id extension" 2547 shown in FIG. 25 are 

J o VE_id_extensions of VET[16] and [15]. respectively. 
This indicates that the hyperlink table defines link-target 
VETs 

From the above description, the following proce- 
dures are required in the second embodiment forchang- 
4 5 ing still pictures 

A VE_id_extension written tn hyperlink table — a 
VET with the VE jd_extension — a stream_id included 
in the VET — a VE with the stream_id 

cache manager 1 7 operates as follows in the sec- 
50 ond embodiment 

When the operator determines an icon on an inter- 
active screen, cache manager 17 detects an HDjndex 
number corresponding to the determined icon by refer- 
ring to the object definition table detects an HL_index 
55 number corresponding to the HD_index number by re- 
ferring to the handler definition table, and detects a 
VE_id_extension corresponding to the HL_index 
number by referring to the hyperlink table Cache man- 
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ager 17 allows demodulator 10 and T3 decoder 11 to 
receive a VET having the detected VEJd extension 
among the plurality of VETs included in the transport 
stream. Cache manager 17 fetches a streamjd and a 
component_tag from the received VET. Cache manager 5 
17 fetches a PID corresponding to the component_tag 
from the PMT. Cache manager 17 watts for a VE with 
the stream_id and the PiD to be transmitted. If the VE 
ts transmitted, cache manager 17 receives it. 

After receiving a link-target VE in the above proce- 10 
dure, cache manager 17 also receives a link-target AE 
in a similar procedure. Cache manager 17 instructs in- 
put switching unit 22 to store the received VE and AE 
into presentation cache unit 15 as a presentation 
stream. 1$ 

With the above construction, it is possible for the 
digital satellite broadcasting system, which broadcasts 
a large number of still pictures, to display interactive 
screens including a still picture specified as a link des- 
tination by a determination operation in another mterac- 2° 
tive screen. This is achieved by the reference of VETs 
included between VEs in the transport stream. 

The two embodiments described above are exam- 
ples of the present invention with which best effects are 
expected. It is also possible to change the embodiments 25 
as follows: 

(a) In the present embodiments the highest rank in 
the navigation information is indicated by integer 
"1 However, the highest rank may be integer "255" 30 
which ts the highest value for 8-bit data in binary 
notation. 

(B) In the present embodiments, mode managing 
unit 1 9 manages the cache mode in cache manager 

17 However, the operator may input an instruction os 
for changing a cache mode to another cache mode. 
Alternately, an NIT including the cache mode may 
be transmitted. 

(C) In the present embodiments, cache processing 
unit 21 processes both navigation cache unit navi- -*o 
gation cache unit 14 and presentation cache unit 

15 However, navigation cache unit navigation 
cache unit 14 and presentation cache una 15 may 
be processed by other two units, respectively. 

(D) In the present embodiments cache manager 1 7 -is 
suspends the reproduction until the cache end flag 

is set to "1 " However, the reproduction may be con- 
tinued without suspension. 

(E) In the present embodiments cache manager 1 7 
stores each NVT and presentation stream sepa- =o 
rately in navigation cache unit 14 and presentation 
cache unit 15 respectively. However, demodulator 

10 and TS decoder 11 may receive a plurality of 
NVTs and presentation streams in a transport 
stream at each reception so that they are stored in 
navigation cache unit 14 and presentation cache 
unit 15 with batch processing. 

(F) In the present embodiments, cache processing 



unit 21 deletes presentation streams or NVTs for ef- 
fective use of the memory. However, the presenta- 
tion streams or NVTs may not be deleted and be 
used again if the memory capacity allows it. 

(G) In the present embodiments, presentation 
streams and NVTs one generation later than the 
content related to the determined icon are read in 
advance. However, a certain number of presenta- 
tion streams and NVTs may be selected from those 
one generation later and two generations later than 
the current content and be read in advance. 

(H) In the present embodiments, presentation 
streams or NVTs without marks are deleted. How- 
ever presentation streams or NVTs to be deleted 
may be determined based on the number of times 
they have been displayed in past, with a certain 
threshold value. 

(I) Presentation cache unit 15 may be deleted from 
the construction. In such a case, the system oper- 
ates as follows: 

cache manager 17 obtains only NVTs having 
possibility of being displayed according to a current 
NVT in navigation cache unit 1 4 and stores them in 
navigation cache unit 14 while an input of an oper- 
ation instruction is waited for on an interactive 
screen 

When the operator determines an icon o"n the 
interactive screen, the link-target content is deter- 
mined referring to the current NVT. *1 

If the link-target NVT has been stored in navi- 
gation cache unit 14. the link-target presentation 
stream is obtained according to the link-target NVT 
and is stored in navigation cache unit 14 The NVT 
and presentation stream are displayed. Such a con- 
struction takes more time in displaying the link-tar- 
get NVT and presentation stream since they are ob- 
tained one by one However it has a merit of delet- 
ing presentation cache unit 15 from the construc- 
tion. Further in case the link-target interactive 
screen is composed of only the bit maps specified 
by an NVT. the presentation stream need not be ob- 
tained. This provides an effect of simplifying the 
construction and speeding up the display of the in- 
teractive screen 

(J) Navigation cache unit 14 may be deleted from 
the construction and presentation cache unit 15 
may store only presentation streams. 
iK) In the secona embodiment. VEs including still 
pictures are identified by using "streamed. M How- 
ever different PIDs may be used instead of 
"streamed." On the other hand, though in the first 
embodiment. VEs including motion pictures are 
identified by using different PIDs. a common PID 
and "streamed" may be used instead. 
(L) The procedure of the caching manager or the 
browser may be written in a machine-language pro- 
gram and be recorded in a record medium such as 
an I C card, optical disc, or floppy disk. The recorded 
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machine-language program is installed on a gener- 
al-purpose hardware apparatus for use. where the 
general-purpose hardware apparatus indicates a 
personal computer which is connected to a parabol- 
ic antenna and includes built-in decoder. TS decod- 
er, and AV decoder. Such a personal computer ex- 
ecutes the installed machine-language program to 
achieve the features of the present apparatus de- 
scribed in the first and second embodiments. 
(M) In the first embodiment, as many whole pres- 
entation streams as possible are stored in presen- 
tation cache unit 15 However, only the first frames 
or representative frames may be stored instead. 

Although the present invention has been fully de- 
scribed by way of examples with reference to the ac- 
companying drawings, it is to be noted that various 
changes and modifications will be apparent to those 
skilled in the art. Therefore, unless such changes and 
modifications depart from the scope of the present in- 
vention, they should be construed as being included 
therein. 



Claims 

1 . A terminal apparatus for displaying an image by re- 
producing one out of m pieces of image information 
and for interactively changing the image using n 
pieces of navigation information, wherein the image 
is one of a moving picture, a still picture, and a mix- 
ture of a moving picture and a still picture, wherein 
the m pieces of image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than "1." the terminal 
apparatus including; 

cache means for storing a pair of one out of the 
m pieces of image information and one out of 
the n pieces of navigation information 
reproducing means for reproducing the one out 
of the m pieces of image information stored in 
the cache means. 

monitoring means for monitonng whether an 
operator has performed a certain operation re- 
sponding to the image displayed, 
receiving means for before the monitonng 
means determines that the operator has per- 
formed the certain operation, receiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of 
image information based on the one out of the 



n pieces of navigation information stored in the 
cache means, and storing the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s is an in- 
5 teger satisfying 1 *^$<m. and t is an integer sat- 

isfying 1 * ;; t<n; 

specifying means for specifying one out of the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 

w itoring means monitors that the operator has 

performed the certain operation: 
identifying means for identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified by the specifying means as one 

is out the s pieces of image information stored in 

the cache means: and 

first controlling means for reading the piece of 
link-target image information identified by the 
identifying means and instructing the reproduc- 
es ing means to reproduce the piece of link-target 
image information, and instructing the receiving 
means to receive other s pieces of image infor- 
mation and other t pieces of navigation infor- 
mation based on one out of the t pieces of nav- 



25 igation information in the cache means corre- 

sponding to the piece of link-target image infor- 
mation identified by the identifying means 

2. The terminal apparatus of Claim 1 further compris- 
30 ing: 



superimposing means for superimposing, 
based on a piece of navigation information cor- 
responding to the one out of the m pieces of 

35 image information stored in the cache means. 

a plurality of icons on the image which is dis- 
played when the reproducing means reproduc- 
es the one out of the m pieces of image infor- 
mation wherein 
the monitoring means includes, 
a determination operation detecting unit for de- 
tecting a determination operation performed on 
one out of the plurality of icons, wherein 
the identifying means identifies one out of the 

^5 plurality pieces of link-target image information 

detected by the determination operation detect- 
ing unit 

3. The terminal apparatus of Claim 2 further compris- 
50 mg 

default image reproducing means for. when the 
identifying means fails to identify the one out of 
the plurality pieces of link-target image informa- 
55 tion specified by the specifying means, repro- 

ducing a default image and 
second controlling means for instructing the re- 
ceiving means to receive the piece of link-target 
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image information specified by the specifying 
means when the piece of link-target image in- 
formation is not identified by the identifying 
means, and to receive a piece of navigation in- 
formation corresponding to the piece of link-tar- $ 
get image information specified by the specify- 
ing means, and sioring the received piece of 
link-target image information and the corre- 
sponding piece of navigation information in the 
cache means, wherein 10 
the superimposing means superimposes a plu- 
rality of icons on the image based on the piece 
of navigation information received by the re- 
ceiving means. 

15 

The terminal apparatus of Claim 2. wherein 

the reproducing means includes 
focus setting means for making one out of the 
plurality of icons be in focus, wherein 20 
the monitoring means includes: 
a cursor move operation detecting unit for de- 
tecting a cursor move operation: and 
a focus changing unit'for making another one 
out of the plurality of icons be in focus based 25 
on the cursor move operation detected by the 
cursor move operation detecting unit, wherein 
the determination operation detecting unit de- 
tects a determination operation performed on 
the other one out of the plurality of icons in fo- 30 
cus. 

The terminal apparatus of Claim 1 further compris- 
ing: 

35 

rank setting means for setting ranks of the m 
pieces of image information stored in the cache 
means based on possibility of being displayed: 
and 

cache table registering means for registering -to 
identifiers of high ranking s pieces of image in- 
formation in a cache table, out of the m pieces 
of image information and registering identifiers 
of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 4 $ 
information, wherein 

the receiving means receives the s pieces of 
image information whose identifiers are regis- 
tered by the cache table registering means and 
receives t pieces of navigation information cor- so 
responding to the s pieces of image informa- 
tion. 



to be ?n focus by the focus setting means and 
for weighting, with a second highest value, 
icons adjacent to the one in focus, wherein 
the rank setting means sets ranks of the m piec- 
es of image information based on values 
weighed by the weighting means. 

7. The terminal apparatus of Claim 6 further compris- 
ing: 

deleting means for deleting, out of the identi- 
fiers of high ranking s pieces of image information 
and t pieces of navigation information in the cache 
table, identifiers of pieces of image information and 
pieces of navigation information which have been 
stored in the cache means. 

8. The terminal apparatus of Claim 7. wherein 

the receiving means includes: 
a receiving unit for receiving, out of the s pieces 
of image information and t pieces of navigation 
information with corresponding identifies regis- 
tered tn the cache table, a piece of image infor- 
mation with a highest rank and a piece of nav- 
igation information corresponding to the piece 
of image information with the highest rank, 
wherein 

the terminal apparatus includes: 
data size judging means for judging whether 
capacity of a free area in the cache means'ex- 
ceeds a data size of the piece of image infor- 
mation with (he highest rank and the piece of 
navigation information corresponding tq^the 
piece of image information with the highest 
rank and 

writing means for writing the piece of image in- 
formation with the highest rank and the corre- 
sponding piece of navigation information into 
the free area when the data size judging means 
judges that the capacity of the free area ex- 
ceeds the data size of the piece of image infor- 
mation with the highest rank and the corre- 
sponding piece of navigation information, 
wherein 

the receiving unit receives a piece of image in- 
formation with a second highest rank and a 
piece of navigation information corresponding 
to ine piece of image information with the sec- 
one highest rank after the writing means writes 
the piece of image information with the highest 
rank and the corresponding piece of navigation 
information into the free area. 



The terminal apparatus of Claim 5 further compris- 
ing: 

weighting means for weighting, with a highest 
value, the one out of the plurality of icons made 



9. The terminal apparatus of Claim S. wherein 

the data size judging means includes: 

a f'ame size judging unit for. when the data size 

judging means judges that the capacity of the 
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free area in the cache means does not exceed 
the data size of the piece of image information 
with the highest rank and the corresponding 
piece of navigation information, judging wheth- 
er the capacity of the free area in the cache s 
means exceeds the data size of a frame of the 
piece of image information with the highest rank 
and a piece of navigation information corre- 
sponding to the piece of image information with 
the highest rank, wherein 10 
the writing means includes: 
a frame writing unit for writing the frame of the 
piece of image information with the highest rank 
and the piece of navigation information corre- 
sponding to the piece of image information with is 
the highest rank into the free area when the 
frame size judging unit judges that the capacity 
of the free area tn the cache means exceeds 
the data size of the frame of the piece of image 
information with the highest rank and the piece 
of navigation information corresponding to the 
piece of image information with the highest 
rank. 

10. The terminal apparatus of Claim 9. wherein 2s 

the data size judging means further includes: 
an oldest image information detecting unit for 
out of the image information and the navigation 
information stored in the cache means, detect- 30 
ing a piece of oldest image information and a 
piece of oldest navigation information when the 
frame size judging unit judges that the capacity 
of the free area in the cache means does not 
exceed the data stze of the frame of the piece zs 
of image information with the highest rank and 
the piece of navigation information correspond- 
ing to t -j? piece of image information with the 
highest : ank : wherein 

the frame writing unit overwrites the frame of j o 
the piece of image information with the highest 
rank and the corresponding piece of navigation 
information in an area in which the piece of old- 
est image informatjon and the piece of oldest 
navigation information are stored. - 5 

1 1 . The terminal apparatus of Claim 7 further compris- 
ing: 

hit pair determining means for determining, as so 
a hit pair, a pair of a piece of image information 
and a piece of navigation information which are 
specified by the operator by determining a cor- 
responding icon out of the image information 
and the navigation information stored in the ss 
cache means: 

mark assigning means for assigning a mark in- 
dicating a hit to the pair of the piece of image 



information and the piece of navigation infor- 
mation determined as the hit pair by the hit pair 
determining means: and 

area freeing means for freeing areas to which 
the mark is not assigned by the mark assigning 
means, out of the image information and the 
navigation information stored in the cache 
means 

12. The terminal apparatus of Claim 5 further compris- 
ing: 

statistics value storing means for storing a sta- 
tistics value for each piece of image information 
which indicates a number of times the piece of 
image information has been determined, 
wherein 

the rank setting means sets ranks of the m piec- 
es of image information based on the statistics 
value for each piece of image information. 

13. The terminal apparatus of Claim 12. wherein 

the monitoring means includes: 
an incrementing unit for incrementing, by one 
a statistics value for a piece of image informa- 
tion when the piece of image information is de- 
termined. 

1 4. The terminal apparatus of Claim 1 3 further compris- 
ing: 

deleting means for deleting, out of the identi- 
fiers of high ranking s pieces of image information 
and t pieces of navigation information in the cache 
table, identifiers of pieces of image information and 
pieces of navigation information which have been 
stored in the cache means. 

15. The terminal apparatus of Claim 14. wherein 

the receiving means includes 
a receiving unit for receiving, out of the s pieces 
of image information and t pieces of navigation 
information with corresponding identifies regis- 
tered sn the cache table a piece of image infor- 
mation with a highest rank and a piece of nav- 
igation information corresponding to the piece 
of image information with the highest rank 
wherein 

the terminal apparatus includes 
data size judging means for judging whether 
capacity of a free area in the cache means ex- 
ceeds a data size of the piece of image infor- 
mation with the highest rank and the piece of 
navigation information corresponding to the 
piece of image information with the highest 
rank, and 

writing means for writing the piece of image m- 
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formation with the highest rank and the corre- 
sponding piece of navigation information into 
the free area when the data size judging means 
judges that the capacity of the free area ex- 
ceeds the data size of the piece of image infor- 
mation with the highest rank and the corre- 
sponding piece of navigation in formation . 
wherein 

the receiving unit receives a piece of image in- 
formation with a second highest rank and a 
ptece of navigation information corresponding 
to the piece of image information with the sec- 
ond highest rank after the writing means writes 
the piece of image information with the highest 
rank and the corresponding piece of navigation 
information into the free area. 

16. The terminal apparatus of Claim 15. wherein 

the data size judging means includes: 
a frame size judging unit for. when the data size 
judging means judges that the capacity of the 
free area in the cache means does not exceed 
the data size of the piece of image information 
with the highest rank and the corresponding 
piece of navigation information, judging wheth- 
er the capacity of the free area in the cache 
means exceeds the data stze of a frame of the 
piece of image information with the highest rank 
and a piece of navigation information corre- 
sponding to the piece of image information with 
the highest rank, wherein 
the writing means includes: 
a frame writing unit for writing the frame of the 
piece of image information with the highest rank 
and the piece of navigation information corre- 
sponding to the piece of image information with 
the highest rank into the free area when the 
frame size judging unit judges that the capactiy 
of the free area in the cache means exceeds 
the data size of the frame of the piece of image 
information with the highest rank and the piece 
of navigation information corresponding to the 
piece of image information with the highest 
rank 

17. The terminal apparatus of Claim 16 wherein 

the data size judging means further includes 
an oldest image information detecting unit for 
out of the image information and the navigation 
information stored in the cache means, detect- 
ing a piece of oldest image information and a 
piece of oldest navigation information when the 
frame size judging unit judges that the capacity 
of the free area in the cache means does nci 
exceed the data size of the frame of the piece 
of image information with the highest rank and 



the piece of navigation information correspond- 
ing to the piece of image information with the 
highest rank, wherein 

the frame writing unit overwrites the frame of 
5 the piece of image information with the highest 

rank and the corresponding piece of navigation 
information in an area in which the piece of old- 
est image information and the piece of oldest 
navigation information are stored 

10 

1 8. The terminal apparatus of Claim 1 4 further compris- 
ing: 

hit pair determining means for determining, as 

>5 a hit pair, a pair of a piece of image information 

and a piece of navigation information which are 
specified by the operator by determining a cor- 
responding icon out of the image information 
and the navigation information stored in the 

20 cache means. 

mark assigning means for assigning a mark in- 
dicating a hit to the pair of the piece of image 
information and the piece of navigation infor- 
mation determined as the hit pair by the hit pair 

25 determining means: and 

area freeing means for freeing areas to "which 
the mark is not assigned by the mark assigning 
means, out of the image information and the 
navigation information stored in the cache 

JO means. 

19. The terminal apparatus of Claim 5 further compris- 
ing: 

35 rank information detecting means for detecting 

a piece of rank information from the piece of 
navigation information corresponding ~to the 
one out of the m pieces of image information 
reproduced by the reproducing means, wherein 
•to the piece of rank information includes ranks of 

the plurality pieces of link-target image informa- 
tion, wherein 

the rank setting means sets ranks of the m piec- 
es of image information based on the piece of 
rank information 

20. The terminal apoaratus of Claim 1 9 further compris- 
ing. 

deleting means for deleting, out of the identi- 
fiers of high ranking s pieces of image information 
and t pieces of navigation information in the cache 
table, identifiers of pieces of image information and 
pieces of navigation information which have been 
stored in the cache means 

21. The terminal apparatus of Claim 20 wherein 
the receiving means includes: 
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a receiving unit for receiving, out of the s pieces 
of image information and t pieces of navigation 
information with corresponding identifies regis- 
tered in the cache table, a piece of image infor- 
mation with a highest rank and a piece of nav- = 
tgation information corresponding to the piece 
of image information with the highest rank, 
wherein 

the terminal apparatus includes: 
data size judging means for judging whether '0 
capacity of a free area in the cache means ex- 
ceeds a data size of the piece of image infor- 
mation with the highest rank and the piece of 
navigation information corresponding to the 
piece of image information with the highest 75 
rank: and 

writing means for writing the piece of image in- 
formation with the highest rank and the corre- 
sponding piece of navigation information into 
the free area when the data size judging means 20 
judges that the capacity of the free area ex- 
ceeds the data size of the piece of image infor- 
mation with the highest rank and the corre- 
sponding piece of navigation information, 
wherein 25 
the receiving unit receives a piece of image in- 
formation with a second highest rank and a 
piece of navigation information corresponding 
to the piece of image information with the sec- 
ond highest rank after the writing means writes JO 
the piece of image information with the highest 
rank and the corresponding piece of navigation 
information into the free area. 

The terminal apparatus of Claim 21 wherein - ? 5 

the data size judging means includes 
a frame size judging unit for. when the data size 
judging means judges that the capacity of the 
free area in the cache means does not exceed 
the data size of the piece of image information 
with the highest rank and the corresponding 
piece of navigation information, judging wheth- 
er the capacity of the free area in the cache 
means exceeds the data size of a frame of the 
piece of image information with the highest rank 
and a piece of navigation information corre- 
sponding to the piece of image information with 
the highest rank, wherein 

the writing means includes: 50 
a frame writing unit for writing the frame of the 
piece of image information with the highest rank 
and the piece of navigation information corre- 
sponding to the piece of image information with 
the highest rank into the free area when the 55 
frame size judging unit judges that the capacity 
of the free area in the cache means exceeds 
the data size of the frame of the piece of image 



information with the highest rank and the piece 
of navigation information corresponding to the 
piece of image information with the highest 
rank. 

23. The terminal apparatus of Claim 22. wherein 

the data size judging means further includes: 
an oldest image information detecting unit for. 
out of the image information and the navigation 
information stored in the cache means : detect- 
ing a piece of oldest image information and a 
piece of oldest navigation information when the 
frame size judging unit judges that the capacity 
of the free area in the cache means does not 
exceed the data size of the frame of the piece 
of image information with the highest rank and 
the piece of navigation information correspond- 
ing to the piece of image information with the 
highest rank, wherein 

the frame writing unit overwrites the frame of 
the piece of image information with the highest 
rank and the corresponding piece of navigation 
information in an area in which the piece of old- 
est image information and the piece of oldest 
navigation information are stored. 

24. The terminal apparatus of Claim 20 further compris- 
ing: 

rank information detecting means for detecting 
a piece of rank information from the piece of 
navigation information corresponding to the 
one out of the rr. pieces of image information 
reproduced by the reproducing means, wherein 
the piece of rank information includes ranks of 
the plurality pieces of link-target image informa- 
tion, wherein 

the rank setting means sets ranks of the m piec- 
es of image information based on the piece of 
rank information. 

25. A terminal apparatus for displaying an image by re- 
producing one out of m pieces of image information 
and for interactively changing the image using n 
pieces of navigation information wherem the image 
is one of a moving picture a stilt picture and a mix- 
ture of a moving picture and a still picture, wherein 
the m pieces of image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than "1." the terminal 
apparatus comprising: 
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reproducing means for reproducing the one out 

of the m pieces of image information: 

cache means for storing one out of the n pieces 

of navigation information which corresponds to 

the one out of the m pieces of image mforma- £ 

tion; 

monitoring means for monitoring whether an 
operator has performed a certain operation re- 
sponding to the image displayed: 
first receiving means for. before the monitoring w 
means determines that the operator has per- 
formed the certain operation, receiving, based 
on the piece of navigation information stored in 
the cache means, t pieces of navigation infor- 
mation which are respectively related to s piec- is 
es of image information having possibility of be- 
ing displayed, and storing the t pieces of navi- 
gation information in the cache means, wherein 
s is an integer satisfying 1^s<m. and t is an 
integer satisfying "h-Un: 20 
specifying means for specifying one out of the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
performed the certain operation: 2S 
identifying means for identifying a piece of nav- 
igation information corresponding to the one 
out of the plurality pieces of link-target image 
information specified by the specifying means 
as one out of the t pieces of navigation informa- 
tion stored in the cache means: and 
second receiving means for receiving the piece 
of link-target image information based on the 
piece of navigation information in the cache 
means corresponding to the piece of link-target 35 
image information specified by the specifying 
means and storing the piece of tink-target im- 
age information in the cache means, wherein 
the reproducing means reproduces the piece of 
link-target image information received by the -to 
second receiving means. 

26. The terminal apparatus of Claim 25 further compris- 
ing: 

j§ 

superimposing means for superimposing, 
based on a piece of navigation information cor- 
responding to the one out of the m pieces of 
image information stored in the cache means, 
a plurality of icons on the image which is dis- 50 
played when the reproducing means reproduc- 
es the one out of the m pieces of image infor- 
mation, wherein 
the monitoring means includes: 
a determination operation detecting unit for de- 55 
tecting a determination operation performed on 
one out of the plurality of icons, wherein 
the identifying means identifies one out of the 



plurality pieces of link-target image information 
detected by the determination operation detect- 
ing unit. 

27. The terminal apparatus of Claim 26 further compris- 
ing: 

default image reproducing means for. when the 
identifying means fails to identify the piece of 
navigation information in the cache means, re- 
producing a default image: and 
controlling means for instructing the first receiv- 
ing means to receive the piece of navigation in- 
formation when the piece of navigation informa- 
tion is not identified by the identifying means. 

28. The terminal apparatus of Claim 27. wherein 

the reproducing means includes: 
focus setting means for making one out of the 
plurality of icons be in focus, wherein 
the monitoring means includes: 
a cursor move operation detecting unit for de- 
tecting a cursor move operation: and 
a focus changing unit for making another one 
out of the plurality of icons be in focus based 
on the cursor move operation detected by the 
cursor move operation detecting unit, wherein 
the determination operation detecting unit de- 
tects a determination operation performed on 
the other one out of the plurality of icons in fo- 
cus. 

29. The terminal apparatus of Claim 26 further compris- 
ing- ■ 

rank setting means for setting ranks of the n 
pieces of navigation information based on pos- 
sibility of being displayed: and 
cache table registering means for registering 
identifiers of high ranking t pieces of navigation 
information in a cache table, out of the n pieces 
of navigation information, wherein 
the receiving means receives the t pieces of 
navigation information specified by the identifi- 
ers registered in the cache table. 

30. The terminal apparatus of Claim 25 further compris- 
ing. 

weighting means for weighting, with a highest 
value, the one out of the plurality of icons made 
to be in focus by the focus setting means, and 
for weighting, with a second highest value, 
icons adjacent to the one in focus wherein 
the rank setting means sets ranks of the n piec- 
es of navigation information based on values 
weighted by the weighting means. 
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31 . The terminal apparatus of Claim 30 further compris- 
ing 

deleting means for deleting, cut of the identi- 
fiers of high ranking t pieces of navigation informa- 
tion in the cache table, identifiers oi pieces of nav- 
igation information which have been stored in the 
cache means. 

32. The terminal apparatus of Claim 31 wherein 

the first receiving means includes: 

a receiving unit for receiving, out of the t pieces 

of navigation information with corresponding 

identifies registered in the cache table, a piece 

of navigation information with a highest rank. 

wherein 

the terminal apparatus includes: 
data size judging means for judging whether 
capacity of a free area in the cache means ex- 
ceeds a data size of the piece of navigation in- 
formation with the highest rank: and 
writing means for writing the piece of navigation 
information with the highest rank into the free 
area when the data size judging means judges 
that the capacity of the free area exceeds the 
data size of the piece of navigation information 
with the highest rank, wherein 
the receiving unit receives a piece of navigation 
information with a second highest rank after the 
writing means writes the piece of navigation in- 
formation with the highest rank into the free ar- 
ea. 

33. A terminal apparatus for displaying an image by re- 
producing one out of m pieces of image information 
and for interactively changing the image using n 
pieces of navigation information wherein the image 
is one of a moving picture a still picture, and a mix- 
ture of a moving picture and a still picture, wherein 
the m pieces of image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus 
wherein each piece of navigation information is re- 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
mation wherein m and n are eacr an integer either 
of being equal to and larger than "1 " the terminal 
apparatus comprising: 
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means determines that the operator has per- 
formed the certain operation, receiving, based 
on a piece of navigation information corre- 
sponding to the one out of the m pieces of im- 
5 age information, s pieces of image information 

which have possibility of being displayed, and 
storing the s pieces of image information in the 
cache means, wherein s is an integer satisfying 
1 <s<m: 

10 specifying means for specifying one out of the 

plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
performed the certain operation: 

15 identifying means for identifying the one out of 

the plurality pieces of link-target image informa- 
tion specified by the specifying means as one 
out of the s pieces of image information stored 
in the cache means: and 

20 second receiving means for receiving the one 

out of the s pieces of image information from 
the cache means, wherein 
the reproducing means reproduces the one out 
of the s pieces of image information received 

25 by the second receiving means. 

34. The terminal apparatus of Claim 33 further compris- 
ing: 

30 superimposing means for superimposing, 

based on a piece of navigation information cor- 
responding to the one out of the m pieces of 
image information stored in the cache means, 
a plurality of icons on the image which is dis- 

3S played when the reproducing means reproduc- 

es the one out of the m pieces of image infor- 
mation, wherein 
the monitoring means includes: 
a determination operation detecting unit for de- 

-io tecting a determination operation performed on 

one out of the plurality of icons, wherein 
the identifying means identifies one out of the 
plurality pieces of link-target image information 
detected by the determination operation detect- 

■is ing unit 

35. The terminal apparatus of Claim 34 further compris- 
ing: 



cache means for storing one out of the m pieces 50 
of image information: 

reproducing means for reproducing the one out 
of the m pieces of image information stored in 
the cache means: 

monitoring means for monitoring whether an 55 
operator has performed a certain operation re- 
sponding to the image displayed: 
first receiving means for. before the monitoring 



default image reproducing means for. when the 
identifying means fails to identify the piece of 
image information in the cache means, repro- 
ducing a default image: and 
controlling means for instructing the first receiv- 
ing means to receive the piece of image infor- 
mation when the piece of image information is 
not identified by the identifying means. 
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36. The terminal apparatus of Claim 35. wherein 

the reproducing means includes: 
focus seli'ng means for making one out of the 
plurality ot icons be in focus, wherein 
the monitoring means includes: 
a cursor r*.ove operation detecting unit for de- 
tecting a cursor move operation: and 
a focus changing unit for making another one 
out of the plurality of icons be in focus based 
on the cursor move operation detected by the 
cursor move operation detecting unit, wherein 
the determination operation detecting unit de- 
tects a determination operation performed on 
the other one out of the plurality of icons in fo- 
cus. 

37. The terminal apparatus of Claim 34 further compris- 
ing: 

rank setting means for setting ranks of the m 
pieces of (mage information based on possibil- 
ity of being displayed: and 
cache table registering means for registering 
identifiers of high ranking s pieces of image in- 
formation m a cache table, out of the m pieces 
of image fnformation. wherein 
the receiving means receives the s pieces of 
image information specified by the identifiers 
registered in the cache table. 

38. The terminal apparatus of Claim 33 further compris- 
ing: 

weighting means for weighting, with a highest 
value the one out of the plurality of icons made 
to be in focus by the focus setting means, and 
for weighting, with a second highest value, 
icons adjacent to the one tn focus, wherein 
the rank setting means sets ranks of the m piec- 
es of image information based on values 
weighted by the weighting means 

39. The terminal apparatus of Claim 36 further compris- 
ing: 

deleting means for deleting, out of the identi- 
fiers of high -anking s pieces of image information 
in ihe cache table identifiers of pieces of image in- 
formation which have been stored in the cache 
means. 

40. The terminal apparatus of Claim 39. wherein 

the first receiving means includes: 
a receiving unit for receiving, out of the s pieces 
of image information with corresponding iden- 
tifies registered in the cache table a piece of 
image information with a highest rank, wherein 
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the terminal apparatus includes: 
data size judging means for judging whether 
capacity of a free area in the cache means ex- 
ceeds a data size of the piece of image infor- 
mation with the highest rank: and 
writing means for writing the piece of image in- 
formation with the highest rank into the free ar- 
ea when the data size judging means judges 
that the capacity of the free area exceeds the 
data size of the piece of image information with 
the highest rank, wherein 
the receiving unit receives a piece of image in- 
formation with a second highest rank after the 
writing means writes the piece of image infor- 
mation with the highest rank into the free area. 

A terminal apparatus for displaying an image by re- 
producing one out of m pieces of image information 
and for interactively changing the image using n 
pieces of navigation information, wherein the image 
is one of a moving picture, a still picture, and a mix- 
ture of a moving picture and a still picture, wherein 
the m pieces of image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the. terminal apparatus, 
wherein each piece of navigation information js re- 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image" infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than "1." the terminal 
apparatus including: 

cache means for storing a pair of one cut of the 
m pieces of image information and onejDut of 
the n pieces of navigation information: 
reproducing means for reproducing the one out 
of the m pieces of image information stored in 
the cache means. 

monitoring means for monitoring whether an 
operator has performed a certain operation re- 
sponding to the image displayed: 
receiving means for. before the monitoring 
means determines that the operator has per- 
formed the certain operation, receiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of 
image information based on the one out of the 
n pieces of navigation information stored in the 
cache means and storing the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means wherein s is an in- 
teger satisfying 1 ^s<m. and t is an integer sat- 
isfying 1 <'t<n: 

specifying means for specifying one out of the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
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performed the certain operation: 
identifying means for identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified by the specifying means as one 
out the s pieces of image information stored in s 
the cache means: 

first controlling means for reading the piece of 
link-target image information identified by the 
identifying means and instructing the reproduc- 
ing means to reproduce the piece of link-target 10 
image information, and instructing the receiving 
means to receive other s pieces of image infor- 
mation and other t pieces of navigation infor- 
mation based on one out of the t pieces of nav- 
igation information in the cache means corre- '5 
sponding to the piece of link-target image infor- 
mation identified by the identifying means: 
rank setting means for setting ranks of the m 
pieces of image information stored in the cache 
means based on possibility of being displayed: 20 
and 

cache table registering means for registering 
identifiers of high ranking s pieces of image in- 
formation in a cache table, out of the m pieces 
of image information and registering identifiers 2s 
of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 
information wherein 

the receiving means receives the s pieces of 
image information whose identifiers are regis- 30 
tered by the cache table registering means and 
receives t pieces of navigation information cor- 
responding to the s pieces of image informa- 
tion 

35 

42. A terminal apparatus for displaying an image by re- 
producing one out of m pieces of image information 
and for interactively changing the image using n 
pieces of navigation information, wherein the image 
is one of a moving picture a still picture and a mix- 10 
ture of a moving picture and a still picture wherein 
the m pieces of image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- 
tated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than "1." the terminal 
apparatus including: so 

cache means for storing a pair of one out of the 
m pieces of image information and one out of 
the n pieces of navigation information: 
reproducing means for reproducing the one out 55 
of the m pieces of image information stored in 
the cache means: 

monitoring means for monitoring whether an 



operator has performed a certain operation re- 
sponding to the image displayed: 
receiving means for. before the monitoring 
means determines that the operator has per- 
formed the certain operation, receiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of 
image information based on the one out of ihe 
n pieces of navigation information stored in ihe 
cache means, and storing the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s is an in- 
teger satisfying 1 *=s<m. and t is an integer sat- 
isfying 1 ^ : t<n: 

specifying means for specifying one out of the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
performed the certain operation: 
identifying means for identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified by the specifying means as one 
out the s pieces of image information stored tn 
the cache means: 

first controlling means for reading the piece of 
link-target image information identified by the 
identifying means and instructing the reproduc- 
ing means to reproduce the piece of link-target 
image information, and instructing the receiving 
means to receive other s pieces of image infor- 
mation and other t pieces of navigation infor- 
mation based on one out of the t pieces of nav- 
igation information in the cache means corre- 
sponding to the piece of fink-target image infor- 
mation identified by the identifying means 
superimposing means for superimposing, 
based on a piece of navigation information cor- 
responding to the one out of the m pieces of 
image information stored in the cache means 
a plurality of icons on the image which is dis- 
played when the reproducing means reproduc- 
es the one out of the m pieces of image infor- 
mation: 

rank setting means for setting ranks of the m 
pieces of image information stored in the cache 
means based' on possibility of being displayed: 
cache table registering means for registering 
identifiers of high ranking s pieces of image in- 
formation in a cache table, out of the m p»eces 
of image information and registering identifiers 
of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 
information: and 

weighting means for weighting with a highest 
value, the one out of the plurality of icons made 
to be in focus by the focus setting means and 
for weighting : with a second highest value. 
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icons adjacent to the one in focus, wherein 
the reproducing means includes. 

(ocus setting means for making one out 
of the plurality of icons be in focus, wherein 
the monitoring means includes: s 

a determination operation detecting unit for 
detecting a determination operation per- 
formed on one out of the plurality of icons: 
a cursor move operation detecting unit for 10 
detecting a cursor move operation, and 
a focus changing unit for making another 
one out of the plurality of icons be in focus 
based on the cursor move operation de- 
tected by the cursor move operation de- *s 
tecting unit, wherein 

the identifying means identifies one out of the 
plurality pieces of link-target image information 
detected by the determination operation detect- 20 
ing unit, wherein 

the determination operation detecting unit de- 
tects a determination operation performed on 
the other one out of the plurality of icons in fo- 
cus, wherein 2s 
the receiving means receives the s pieces of 
image information whose identifiers are regis- 
tered by the cache table registering means and 
receives t pieces of navigation information cor- 
responding to the s pieces of image informa- 
tion. and wherein 

the rank setting means sets ranks of the m piec- 
es of image information based on values 
weighted by the weighting means. 

A terminal apparatus for displaying an image by re- 
producing one out of m pieces of image information 
and for interactively changing the image using n 
pieces of navigation information, wherein the image 
is one of a moving picture, a still picture, and a mix- -«? 
ture of a moving picture and a still picture, wherein 
the m pieces of image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- 45 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than "1." the terminal 
apparatus including: so 

cache means for storing a pair of one out of the 
m pieces of image information and one out ot 
the n pieces of navigation information: 
reproducing means for reproducing the one out ^ 
of the m pieces of image information stored in 
the cache means. 

monitoring means for monitoring whether an 



operator has performec a certain operation re- 
sponding to the image displayed: 
receiving means for before the monitoring 
means determines that the operator has per- 
formed the certain operation, receiving s pieces 
of image information v.mch have possibility of 
being displayed and t oieces of navigation in- 
formation respectively -elated to the s pieces of 
image information based on the one out of the 
n pieces of navigation information stored in the 
cache means, and stonng the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means : wherein s is an in- 
teger satisfying 1 *rs<n and t is an integer sat- 
isfying 1 * c t<n: 

specifying means for specifying one out of the 
plurality pieces of iink-carget image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
performed the certain operation: 
identifying means for identifying the one out of 
the plurality pieces of lank-target image informa- 
tion specified by the specifying means as one 
out the s pieces of image information stored in 
the cache means: 

first controlling means for reading the piece of 
link-target image information identified by the 
identifying means and instructing the reproduc- 
ing means to reproduce the piece of iink-tar.get 
image information and instructing the receiving 
means to receive other s pieces of image infor- 
mation and other t p;eces of navigation infor- 
mation based on one out of the t pieces of nav- 
igation information the cache means corre- 
sponding to the piece of link-target image infor- 
mation identified by me identifying means: 
superimposing means for superimposing, 
based on a piece of navigation information cor- 
responding to the ore out of the m pieces of 
image information stored in the cache means, 
a plurality of icons on the image which is dis- 
played when the reproducing means reproduc- 
es the one out of the m pieces of image infor- 
mation: 

rank setting means for setting ranks of the m 
pieces of image information stored in the cache 
means based on possibility of being displayed: 
cache table registering means for registering 
identifiers of high ranking s pieces of image in- 
formation in a cache cable, out of the m pieces 
of image information and registering identifiers 
of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 
information: and 

deleting means for deleting, out of the identifi- 
ers of high ranking 5 pieces of image informa- 
tion and t pieces of ravigation information in the 
cache table, identifiers of pieces of image infor- 
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mation and pieces of navigation information 
which have been stored in the cache means, 
wherein 

the monitoring means includes: 

a determination operation deteci;ng unit s 
for detecting a determination operaton per- 
formed on one out of the plurality o? icons, 
wherein 

the identifying means identifies one out of the 
plurality pieces of link-target image information 10 
detected by the determination operation detect- 
ing unit wherein 

the receiving means receives the s pieces of 
image information whose identifiers are regis- 
tered by the cache table registering means and '5 
receives t pieces of navigation information cor- 
responding to the s pieces of image informa- 
tion. 

44. A terminal apparatus for displaying an image by re- 20 
producing one out of m pieces of image information 
and for interactively changing the image using n 
pieces of navigation information, wherein the image 
is one of a moving picture, a still picture, and a mix- 
ture of a moving picture and a still picture, wherein 25 
the m pieces of image information and then pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- 
lated to an origin piece of image information and in- so 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than "I." the terminal 
apparatus including: 

35 

cache means for storing a pair of one out of the 
m pieces of image information and one out of 
the n pieces of navigation information, 
reproducing means for reproducing the one out 
of the m pieces of image information stored in 
the cache means: 

monitoring means for monitoring whether an 
operator has performed a certain operation re- 
sponding to the image displayed, 
receiving means for. before the monitoring 
means determines that the operator has per- 
formed the certain operation, receiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of 50 
image information based on the one out of the 
n pieces of navigation information stored in the 
cache means, and storing the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s is an in- 55 
teger satisfying 1 - ' s<m. and t is an integer sat- 
isfying 1 t<n: 

specifying means for specifying one out of the 
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plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
performed the certain operation: 
identifying means for identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified by the specifying means as one 
out the s pieces of image information stored in 
the cache means: 

first controlling means for reading the piece of 
link-target image information identified by the 
identifying means and instructing the reproduc- 
ing means to reproduce the piece of link-target 
image information, and instructing the receiving 
means to receive other s pieces of image infor- 
mation and other t pieces of navigation infor- 
mation based on one out of the t pieces of nav- 
igation information in the cache means corre- 
sponding to the piece of link-target image infor- 
mation identified by the identifying means: 
superimposing means for superimposing, 
based on a piece of navigation information cor- 
responding to the one out of the m pieces of 
image information stored in the cache means, 
a plurality of icons on the image which is dis- 
played when the reproducing means reproduc- 
es the one out of the m pieces of image infor- 
mation: 

rank setting means for setting ranks of the m 
pieces of image information stored in the cache 
means based on possibility of being displayed: 
cache table registering means for registering 
identifiers of high ranking s pieces of image in- 
formation in a cache table out of the m pieces 
of image information and registering identifiers 
of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 
information: and 

rank information detecting means for detecting 
a piece of rank information from the piece of 
navigation information corresponding to the 
one out of the m pieces of image information 
reproduced by the reproducing means, wherein 
the piece of rank information includes ranks of 
the plurality pieces of link-target image informa- 
tion, wherein 

the monitoring means includes: 

a determination operation detecting unit 
for detecting a determination operation per- 
formed on one out of the plurality of icons, 
wherein 

the identifying means identifies one out of the 
plurality pieces of link-target image information 
detected by the determination operation detect- 
ing unit wherein 

the receiving means receives the s pieces of 
image information whose identifiers are regis- 
tered by the cache table registering means and 
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receives t pieces of navigation information cor- 
responding to the s pieces of image informa- 
tion: and wherein 

the rank setting means sets ranks of the m piec- 
es of image information based on the piece of s 
rank information. 

45. A reproduction method used in a termtnal apparatus 
for displaying an image by reproducing one out of 
m pieces of image information and for interactively io 
changing the image using n pieces of navigation in- 
formation wherein the image is one of a moving pic- 
ture, a stilt picture, and a mixture of a moving picture 
and a still picture, wherein the m pieces of image 
information and the n pieces of navigation informa- 15 
tion together are broadcast by a broadcasting sta- 
tion to the terminal apparatus, wherein each piece 
of navigation information is refated to an origin piece 
of image information and indicates a plurality pieces 
of link-target image information, wherein m and n 20 
are each an integer either of being equal to and larg- 
er than "1 the terminal apparatus comprising: 

cache means for storing a pair of one out of the 
m pieces of image information and one out of 25 
the n pieces of navigation information, wherein 
the reproduction method comprising: 
a reproducing step of reproducing the one out 
of the m pieces of image information stored in 
the. cache means: 30 
a monitoring step of monitoring whether an op- 
erator has performed a certain operation re- 
sponding to the image displayed: 
a receiving step of. before it is determined in 
the monitoring step that the operator has per- 35 
formed the cerlain operation, receiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of 
image information based on the one out of the -to 
n pieces of navigation information stored in the 
cache means and storing the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s is an in- 
teger satisfying ^ *= s<m. and t is an integer sat- 
isfying 1 ^-t<n. 

a specifying step of specifying one out of the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring step monitors that the operator has per- so 
formed the certain operation: 
an identifying step of identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified in the specifying step as one out 
the s pieces of image information stored in the 55 
cache means: and 

a first controlling step of reading the piece of 
link-target image information identified in the 



identifying step and instructing the reproducing 
steo to reproduce the piece of link-target image 
information, and instructing the receiving step 
to -sceive other s pieces of image information 
arc other t pieces of navigation information 
based on one out of the t pieces of navigation 
information in the cache means corresponding 
to :he piece of link-target image information 
identified in the identifying step. 

46. The reproduction method of Claim 45 further com- 
prising 

a superimposing step of superimposing, based 
on a piece of navigation information corre- 
sponding to the one out of the m pieces of im- 
age information stored in the cache means, a 
plurality of icons on the image which is dis- 
played when the one out of the m pieces of im- 
age information is reproduced in the reproduc- 
ing step, wherein 
the monitoring step includes: 
a cetermination operation detecting sub-step of 
detecting a determination operation performed 
on one out of the plurality of icons : wherein 
in the identifying step, one out of the plurality 
pieces of (ink-target image information detect- 
. ec by the determination operation detecting 
unit is identified. ~ 

47. The reproduction method of Claim 46 further com- 
prising, ^ r ^ 

a default image reproducing step of. when the 
csnttfying step fails to identify the one out of 
Ire plurality pieces of link-target image informa- 
tion specified in the specifying step, reproduc- 
ing a default image: and 

a second controlling step of instructing the re- 
ceiving step to receive the piece of link-target 
image information specified in the specifying 
step when the piece of link-target image infor- 
mation is not identified in the identifying step, 
and to receive a piece of navigation information 
corresponding to the piece of link-target image 
information specified in the specifying step, and 
storing the received piece of link-target image 
-formation, and the corresponding piece of 
navigation miormaWon in the cache means 
wherein 

in the superimposing step, a plurality of icons 
are superimposed on the image based on the 
piece of navigation information received in the 
receiving step 

48. The -eproduction method of Claim 46. wherein 

the reproducing step includes 
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a focus setting steo of making one out of the 
plurality of icons be in focus wherein 
the monitoring step includes 
a cursor move operation detecting sub-step of 
detecting a cursor move operation: and 5 
a focus changing sub-step of making another 
one out of the plurality of icons be in focus 
based on the cursor move operation detected 
in the cursor move operation detecting sub- 
step, wherein w 
in the determination operation detecting sub- 
step, a determination operation performed on 
the other one out of the plurality of icons in fo- 
cus is detected. 

75 

49. The reproduction method of Claim 45 further com- 
prising: 

a rank setting step of setting ranks of the m 
pieces of image information stored in the cache 20 
means based on possibility of being displayed: 
and 

a cache table registering step of registering 
identifiers of high ranking s pieces of image in- 
formation in a cache table out of the m pieces 25 
of image information and registering identifiers 
of t pieces of navigation information corre- 
sponding to the rugh ranking s pieces of image 
information wherein 

in the receiving step the s pieces of image in- 30 
formation whose identifiers are registered in the 
cache table reqisterinq step are received and t 
pieces of navigation information corresponding 
to the s pieces of image information are re- 
ceived. 35 

50. The reproduction method of Claim 49 further com- 
prising. 

a weighting step of weighting, with a highest 10 
value the one out of the plurality of icons made 
to be in focus in the focus setting step, and for 
weighting with a second highest value, icons 
adjacent to the one in focus, wherein 
in the rank setting step ranks of the m pieces 4 $ 
of image information are set based on values 
weighted in the weighting step. 

51. The reproduction method of Claim 50 further com- 
prising: 50 

a deleting step of deleting out of the identifi- 
ers of high ranking 5 pieces of image information 
and t pieces of navigation information in the cache 
table, identifiers of pieces of image information and 
pieces of navigation information which have been 55 
stored in the cache means. 

52. A record medium in which a reproduction program 



is recorded the reproduction program being used 
in a terminal apparatus for displaying an image by 
reproducing one out of m pieces of image informa- 
tion and for interactively changing the image using 
n pieces of navigation information wherein the im- 
age is one of a moving picture, a still picture, and a 
mixture of a moving picture and a still picture, 
wherein the m pieces of image information and the 
n pieces of navigation information together are 
broadcast by a broadcasting station to the terminal 
apparatus, wherein each piece of navigation infor- 
mation is related to an origin piece of image infor- 
mation and indicates a plurality pieces of link-target 
image information, wherein m and n are each an 
integer either of being equal to and larger than "1 
the terminal apparatus comprising: 

cache means for storing a pair of one out of the 
m pieces of image information and one out of 
the n pieces of navigation information, wherein 
the reproduction program comprising: 
a reproducing step of reproducing the one out 
of the m pieces of image information stored in 
the cache means: 

a monitoring step of monitoring whether an op- 
erator has performed a certain operation re- 
sponding to the image displayed: 
a receiving step of. before it is determined in 
the monitoring step that the operator has per- 
formed the certain operation, receiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of 
image information based on the one out of the 
n p«eces of navigation information stored in the 
cacne means, and storing the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s is an in- 
teger satisfying 1 ^-s<m. and t is an integer sat- 
isfying 1 ^t<n: 

a specifying step of specifying one out of the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring step monitors that the operator has per- 
formed the certain operation: 
an identifying step of identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified in the specifying step as one out 
the s pieces of image information stored in the 
cache means; and 

a first controlling step of reading the piece of 
link-target image information identified in the 
identifying step and instructing the reproducing 
step to reproduce the piece of link-target image 
information, and instructing the receiving step 
to receive other s pieces of image information 
and other t pieces of navigation information 
based on one out of the t pieces of navigation 



30 



59 



EP 0 827 340 A2 



information tn the cache means corresponding 
to the piece of link-target image information 
identified in the identifying step. 

53. The record medium of Claim 52. wherein 

the reproduction program further comprises: 
a superimposing step of superimposing, based 
on a piece of navigation information corre- 
sponding to the one out of the m pieces of im- 
age information stored in the cache means, a 
plurality of icons on the image which is dis- 
played when the one out of the m pieces of im- 
age information is reproduced in the reproduc- 
ing step, wherein 
the monitoring step includes: 
a determination operation detecting sub-step of 
detecting a determination operation performed 
on one out of the plurality of icons, wherein 
in the identifying step, one out of the plurality 
pieces of link-target image information detect- 
ed by the determination operation detecting 
unit is identified. 

54. The record medium of Claim 53. wherein 

the reproduction program further comprises 
a default image reproducing step of. when the 
identifying step fails to identify the one out of 
the plurality pieces of link-target image informa- 
tion specified in the specifying step, reproduc- 
ing a default image: and 

a second controlling step of instructing the re- 
ceiving step to receive the piece of link-target 
image information specified in the specifying 
step when the piece of link-target image infor- 
mation is not identified in the identifying step, 
and to receive a piece of navigation information 
corresponding to the piece of link-target image 
information specified in the specifying step, and 
storing the received piece of link-target image 
information and the corresponding piece of 
navigation information in the cache means, 
wherein 

in the superimposing step, a plurality of icons 
are superimposed on the image based on the 
piece of navigation information received in the 
receiving step. 

55. The record medium of Claim 53. wherein 

the reproducing step includes: 

a focus setting step of making one out of the 

plurality of icons be in focus, wherein 

the monitoring step includes: 

a cursor move operation detecting sub-step of 

detecting a cursor move operation: and 

a focus changing sub-step of making another 



one out of the plurality of icons be in focus 
based on the cursor move operation detected 
in the cursor move operation detecting sub- 
step, wherein 

s in the determination operation detecting sub- 

step, a determination operation performed on 
the other one out of the plurality of icons in fo- 
cus is detected 

io 56. The record medium of Claim 52. wherein 



the reproduction program further comprises" 
a rank setting step of setting ranks of the m 
pieces of image information stored in the cache 
means based on possibility of being displayed: 
and 

a cache table registering step of registering 
identifiers of high ranking s pieces of image in- 
formation m a cache table, out of the m pieces 
of image information and registering identifiers 
of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 
information, wherein 

in the receiving "step, the s pieces of image in- 
formation whose identifiers are registered in the 
cache table registering step are received and t 
pieces of navigation information corresponding 
to the s pieces of image information are re- 
ceived. 
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57. The record medium of Claim 56. wherein 

the reproduction program further comprises 
a weighting step of weighting, with a highest 
value the one out of the plurality of icons made 
to be in focus in the focus setting step, and for 
weighting with a second highest value, icons 
adjacent to the one in focus, wherein 
in the rank setting step, ranks of the m pieces 
of image information are set based on values 
weighted in the weighting step 

c 

58. The record medium of Claim 57. wherein 

the reproduction program further comprises 
a deleting step of deleting, out of the identifiers 
of high ranking s pieces of image information 
and t pteces of navigation information in the 
cache table, identifiers of pieces of image infor- 
mation and pieces of navigation information 
which have been stored in the cache means 
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FIG. 2A 



NARRA TION INCLUDED IN AUDIO ELEMENTS ] (PIP =0x060 1) 

INTRODUCING INTERACTIVE CHANNEL. 

THANK YOU FOR SELECTING THE 'A' BROADCAST. 

FOR TODAY'S BROADCAST.WE WILL BE SHOWING 
THE FOLLOWING PROGRAMS. WE ARE SURE YOU 
WILL ENJOY THEM. 



MOTION PICTURE INCLUDED IN VIDEO ELEMENTS ](PD=0X202) 

SHOT OF A BROADCASTING COMPANY ANNOUNCER(120 SECONDS) 
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FIG. 2B 



NARRATION INCLUDED IN AUDIO ELEMENT[2] (PID = 0x0602) 



NEW MOVIE INFORMATION. 
COMING UP SOON AT THEATERS IN OSAKA. 



MOTION PICTURE INCLUDED IN VIDEO ELEMENT[2](PID=0X302) -~ 
PR EVIEW OF NEW MOVIES(360 SECONDS) Z 

FIRST FRAME(00:00:00.00SEO^\ 
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FIG. 2C 



NARRATION INCLUDED IN AUDIO ELEMENT! 12] 



COMING UP NOW HIGHLIGHTS FROM "THE TERROR 
OF THE HUGE TORNADO" (DISTRIBUTED BY AAA 
COMPANY). PLEASE SELECT YOUR DESIRED SCENE. 

MOTION PICTURE INCLUDED IN VIDEO ELEMENT!! 2] 

DIGEST VERSION OF "THE TERROR OF THE HUGE TORNADO" 
DISTRIBUTED BY AAA COMPANY(120 SECONDS) 
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FIG. 2D 



NARRATION INCLUDED IN AUDIO ELEMENT [43] 



INTRODUCING THE CAST OF "THE TERROR OF THE HUGE 
TORNADO" (DISTRIBUTED BY AAA COMPANY). 
PLEASE SELECT AN ACTOR/ACTRESS. 



MOTION PICTURE INCLUDED IN VIDEO ELEMENT(43] 

SHOTS OF THE MAIN CAST OF "THE TERROR OF THE HUGE TORNADO' 
DISTRIBUTED BY AAA COMPANY 
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FIG. 4 
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FIG. 6 
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FIG. 10A 



NAVIGATION CACHE UNIT 





NVT 


DISPLAY HISTORY MARK 


1 


NVT[1] 


•HIT 


2 


NVT(2] 


NOT j'UDG 


ED 


3 


NVT(3] 


NOTJL'DG 


ED 


4 


NVT[4] 


XOT.iUDG 


ED 


5 


NVT[5] 


NOT ^DC- 


ED 


1 QO 

NAVIGATION CACHE UNIT 




NVT 


DISPLAY HISTORY MARK 


1 


NVT[1] 


•HIT 


2 


NVT[2J 


•HIT 


3 


NVT[3] 


MISSED 


4 


NVT[4] 


MISSED 


5 


NVT [5] 


MISSED 


. IOC 

NAVIGATION CACHE UNIT 




NVT 


DISPLAY HISTORY MARK 


1 


NVT[1] 


•HIT 


2 


NVT[2] 


•HIT 


3 


FREE AREA 


4 


FREE AREA 


5 


FREE AREA 


' 10D NAVIGATION CACHE UNIT 




NVT 


DISPLAY HISTORY MARK 


1 


NVTll] 


•HIT 




NVT(2] 


•KIT 


'/S 3 V// 


/>NVT[11K/ 


V/, NOT JUDGED // J 


YA * y/A 


//NVT[12]^ 


NOT JUDGED^ 


Ys 5 YYs 


> / / NVT[21]/> 


'// NOT JUDGED '// 



46 



EP O 827 340 A2 



FIG. 10E 
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FIG. 11A 
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FIG. 11D 
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